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METHOD AND APPARATUS FOR EFFICIENT INTEGER TRANSFORM 



RELATED APPLICATIONS 
[0001] This is a continuation-in-part application claiming, under 35 U.S.C. § 120, the 
benefit of the filing date of U.S. application Ser. No. 09/952,891, filed October 29, 2001, 
currently pending. 

FIELD OF THE DISCLOSURE 
[0002] This disclosure relates generally to transform coding techniques for 
compression and decompression of audio, images and video. In particular, the disclosure 
relates to performing integer transforms using Single-Instruction-Multiple-Data (SIMD) 
operations. 

BACKGROUND OF THE DISCLOSURE 
[0003] Media applications have been driving microprocessor development for more 
than a decade. In fact, most computing upgrades in recent years have been driven by 
media applications. These upgrades have predominantly occurred within consumer 
segments, although significant advances have also been seen in enterprise segments for 
entertainment enhanced education and communication purposes. Nevertheless, future 
media applications will require even higher computational requirements. As a result, 
tomorrow's personal computing (PC) experience will be even richer in audio- visual 
effects, as well as being easier to use, and more importantly, computing will merge with 
communications. 
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[0004] Accordingly, the display of images, as well as playback of audio and video 
data, which is collectively referred to herein as content, have become increasingly popular 
applications for current computing devices. Transform coding is a popular technique for 
compression and decompression of audio, images and video. Discrete transforms such as 
the discrete cosine transform (DCT) used in prior compression techniques have made use 
of floating-point or fixed-point number representations to approximate real irrational 
coefficients. However imperfections in these representations may contribute to an inverse 
transform mismatch when performed in the integer domain. 

[0005] More recently integer transforms have been proposed, which have integer basis 
components and permit coefficients to be accurately represented by integers. By choosing 
coefficients which are integer approximations of DCT coefficients, the near optimum 
decorrelation properties of DCTs are preserved. More over, small integer coefficients may 
be selected to permit transforms to be implemented with shifts, additions and subtractions 
rather than multiplications, and some adverse effects of rounding may be avoided. 
[0006] In some computer systems, processors are implemented to operate on values 
represented by a large number of bits (e.g., 32 or 64) using instructions that produce one 
result. For example, the execution of an add instruction will add together a first 64-bit 
value and a second 64-bit value and store the result as a third 64-bit value. However, 
media applications require the manipulation of large amounts of data which may be 
represented in a small number of bits. For example, image data typically requires 8 or 16 
bits and sound data typically requires 8 or 16 bits. To improve efficiency of media 
applications, some prior art processors provide packed data formats. A packed data format 
is one in which the bits typically used to represent a single value are broken into a number 

42P15771 -2- 

r~> 



of fixed sized data elements, each of which represents a separate value. For example, a 64- 
bit register may be broken into two 32-bit elements, each of which represents a separate 
32-bit value. In addition, these prior art processors provide instructions for separately 
manipulating each element in these packed data types in parallel. For example, a packed 
add instruction adds together corresponding data elements from a first packed data and a 
second packed data. Thus, if a multimedia algorithm requires a loop containing five 
operations that must be performed on a large number of data elements, it is desirable to 
pack the data and perform these operations in parallel using packed data instructions. In 
this manner, these processors can more efficiently process content of media applications. 
[0007] Unfortunately, current methods and instructions target the general needs of 
transforms and are not comprehensive. In fact, many architectures do not support a means 
for efficient integer transform calculations over a range of coefficient sizes and data types. 
In addition, data ordering within data storage devices such as SIMD registers, as well as a 
capability of adding adjacent values in a register, are generally not supported. As a result, 
current architectures require unnecessary data type changes which minimizes the number 
of operations per instruction and significantly increases the number of clock cycles 
required to order data for arithmetic operations. 

[0008] Therefore, there remains a need to overcome one or more of the limitations 
existing in the techniques above-described. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] The present invention is illustrated by way of example and not limitation in the 
figures of the accompanying drawings. 

[0010] Figures la-lc illustrate exemplary computer systems according to various 
alternative embodiments of the invention. 

[0011] Figures 2a-2b illustrate register files of processors according to various 
alternative embodiments of the invention. 

[0012] Figure 3 illustrates a flow diagram for one embodiment of a process used by 
the processor to manipulate data. 

[0013] Figures 4a-4b illustrate packed data-types according to various alternative 
embodiments of the invention. 

[0014] Figures 5a-5d illustrate in-register packed data representations according to 
various alternative embodiments of the invention. 

[0015] Figures 6a-6d illustrate operation encoding (opcode) formats for indicating the 
use of packed data according to various alternative embodiments of the invention. 
[0016] Figures 7a-7b illustrate flow diagrams for various alternative embodiments of 
processes for performing multiply-add and multiply-subtract operations on packed data. 
[0017] Figures 8a-8d illustrate alternative embodiments of circuits for performing 
multiply-add and multiply-subtract operations on packed data. 
[0018] Figures 9a-9h illustrate flow diagrams for alternative embodiments of 
processes for performing horizontal-add and horizontal-subtract operations on packed data. 
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[0019] Figures lOa-lOb illustrate alternative embodiments of circuits for performing 
horizontal-add and horizontal-subtract operations on packed data. 
[0020] Figures lla-llb illustrate flow diagrams of one embodiment of a process for 
efficient integer transform processing of content data. 

[0021] Figures 12 illustrates a flow diagram of an alternative embodiment of a process 
for efficient integer transform processing of content data. 

[0022] Figures 13 illustrates one exemplary embodiment of an integer transform for 
processing of content data. 

[0023] Figures 14a-14f illustrate flow diagrams of another alternative embodiment of 
a process for efficient integer transform processing of content data. 
[0024] Figures 15a-15c illustrate flow diagrams of alternative embodiments of 
processes for efficient integer transform processing of content data. 
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DETAILED DESCRIPTION 
[0025] A method and apparatus for efficient integer transforms of content data are 
described. The method includes generating, in response to executing a multiply-add 
instruction, a plurality of sums of product pairs within a destination data storage device. 
The plurality of product pairs are formed by multiplying data within the destination data 
storage device and coefficients within a co-efficient data storage device. In response to 
executing a second multiply-add instruction, a second plurality of sums of product pairs 
may be generated within another destination data storage device. Once generated, adjacent 
summed-product pairs may be added in response to executing a horizontal-add instruction. 
The adjacent summed-product pairs are added and results are stored within the destination 
data storage device. Once formed, the results may also be stored within a memory device. 
[0026] Further disclosed herein is a method and apparatus for including in a processor, 
instructions for performing multiply-add operations and horizontal-add operations on pairs 
of adjacent packed data. In one embodiment, a processor is coupled to a memory that 
stores a first packed byte data and a second packed byte data. The processor performs 
operations on said first packed byte data and said second packed byte data to generate a 
third packed data in response to receiving a multiply-add instruction. A plurality of the 16- 
bit data elements in this third packed data store the result of performing multiply-add 
operations on data elements in the first and second packed byte data. The processor adds 
together adjacent pairs of 16-bit data elements of at least the third packed data in response 
to receiving a horizontal-add instruction to generate, as one of a plurality of data elements 
of a fourth packed data, a 16-bit result. 
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[0027] In one embodiment, the methods of the present invention are embodied in 
machine-executable instructions. The instructions can be used to cause a general-purpose 
or special-purpose processor that is programmed with the instructions to perform the 
processing blocks of the present invention. Alternatively, the steps of the present 
invention might be performed by specific hardware components that contain hardwired 
logic for performing the processing blocks, or by any combination of programmed 
computer components and custom hardware components. 

[0028] The present invention may be provided as a computer program product which 
may include a machine or computer-readable medium having stored thereon instructions 
which may be used to program a computer (or other electronic devices) to perform a 
process according to the present invention. The computer-readable medium may include, 
but is not limited to, floppy diskettes, optical disks, Compact Disc, Read-Only Memory 
(CD-ROMs), and magneto-optical disks, Read-Only Memory (ROMs), Random Access 
Memory (RAMs), Erasable Programmable Read-Only Memory (EPROMs), Electrically 
Erasable Programmable Read-Only Memory (EEPROMs), magnetic or optical cards, flash 
memory, or the like. 

[0029] Accordingly, the computer-readable medium includes any type of 
media/machine-readable medium suitable for storing electronic instructions. Moreover, 
the present invention may also be downloaded as a computer program product. As such, 
the program may be transferred from a remote computer (e.g., a server) to a requesting 
computer (e.g., a client). The transfer of the program may be by way of data signals 
embodied in a carrier wave or other propagation medium via a communication link (e.g., a 
modem, network connection or the like). 
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[0030] In the following description, for the purposes of explanation, numerous specific 
details are set forth in order to provide a thorough understanding of the present invention. 
It will be apparent, however, to one skilled in the art that the present invention may be 
practiced without some of these specific details. In addition, the following description 
provides examples, and the accompanying drawings show various examples for the 
purposes of illustration. In some instances, well-known structures and devices may be 
omitted in order to avoid obscuring the details of the present invention. These examples 
and other embodiments of the present invention may be realized in accordance with the 
following teachings and it should be evident that various modifications and changes may 
be made in the following teachings without departing from the broader spirit and scope of 
the invention. The specification and drawings are, accordingly, to be regarded in an 
illustrative rather than restrictive sense and the invention measured only in terms of the 
claims. 
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Integer Transform O verview 
[0031] This application describes a method and apparatus for including in a processor 
instructions for performing integer transforms on packed data. A separable integer 
transform approximates real transform coefficients, for example of an 8x8 DCT, as 
follows: 
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where ab = ac + bd + cd, when a>b>c>d and e>f . The coefficients are applied to the data 

in both the horizontal and the vertical directions. 

[0032] A 4x4 integer transform may be written as follows: 
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[0033] For example, if a=3, b=2, c=l, d=l, e=2 and f=l, then since 

3-2 = 31 + 21 + 1-1=6, and 3>2>1>1, and 2>1, the following 8x8 integer transform may 

be generated: 
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[0034] Therefore, a 4x4 integer transform corresponding to the example given above 
may be generated as follows: 
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[0035] To provide another example of an integer transform, when a=10, b=9, c=6, 
d=2, e=17 and f=7, then 10-9 = 10-6 + 9-2 + 6-2 = 90, and 10>9>6>2, and 17>7. Therefore 
the following 8x8 integer transform may be generated: 
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[0036] A corresponding 4x4 integer transform may be generated as follows: 

" 13 13 13 13 
T 4 = 17 7 -7 -17 
13 -13 -13 13 
7 -17 17 -7 



[0037] As discussed below especially with regard to Figures 1 la-1 lb, Figure 12 and 
Figures 14a- 14d, efficient 4x4 and/or 8x8 integer transforms of content data may be 
performed by multiply-add instructions and horizontal-add instructions. 
[0038] In accordance with one embodiment of an efficient integer transform of content 
data, a plurality of sums of product pairs is generated within a first data storage device in 
response to executing a multiply-add instruction. The plurality of product pairs are formed 
by multiplying data within the first data storage device and coefficients within a coefficient 
data storage device. One embodiment of the multiply-add instruction multiplies individual 
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unsigned bytes within the first data storage device by the corresponding signed bytes 
within the co-efficient data storage device, producing temporary signed 16-bit results. 
Adjacent temporary 16-bit results are then summed and optionally saturated, the result of 
which is stored in the first data storage device. In response to executing a second multiply- 
add instruction, a second plurality of sums of product pairs may be generated within a 
second data storage device. 

[0039] Once generated, adjacent summed-product pairs from the first and second 
storage devices may be added in response to executing a horizontal-add instruction. One 
embodiment of a horizontal-add instruction adds adjacent signed 16-bit summed-product 
pairs from the first storage device and from the second storage device, writing signed (and 
optionally saturated) 16-bit results to a destination storage device. Once the adjacent 
summed-product pairs are added and the results stored in a destination storage device, the 
results may also be stored in a memory device. 



42P15771 



-12- 



Computer System 

[0040] Figure la illustrates an exemplary computer system 100 according to one 
embodiment of the invention. Computer system 100 includes a bus 101, or other 
communications hardware and software, for communicating information, and a processor 
109 coupled with bus 101 for processing information. Processor 109 represents a central 
processing unit of any type of architecture, including a CISC or RISC type architecture. 
Computer system 100 further includes a random access memory (RAM) or other dynamic 
storage device (referred to as main memory 104), coupled to bus 101 for storing 
information and instructions to be executed by processor 109. Main memory 104 also may 
be used for storing temporary variables or other intermediate information during execution 
of instructions by processor 109. Computer system 100 also includes a read only memory 
(ROM) 106, and/or other static storage device, coupled to bus 101 for storing static 
information and instructions for processor 109. Data storage device 107 is coupled to bus 
101 for storing information and instructions. 

[0041] Figure la also illustrates that processor 109 includes an execution unit 130, a 
register file 150, a cache 160, a decoder 165, and an internal bus 170. Of course, processor 
109 contains additional circuitry which is not necessary to understanding the invention. 
[0042] Execution unit 130 is used for executing instructions received by processor 
109. In addition to recognizing instructions typically implemented in general purpose 
processors, execution unit 130 recognizes instructions in packed instruction set 140 for 
performing operations on packed data formats. Packed instruction set 140 includes 
instructions for supporting multiply-add and/or multiply-subtract operations. In addition, 
packed instruction set 140 may also include instructions for supporting a pack operation, 
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an unpack operation, a packed add operation, a packed subtract operation, a packed 
multiply operation, a packed shift operation, a packed compare operation, a population 
count operation, and a set of packed logical operations (including packed AND, packed 
ANDNOT, packed OR, and packed XOR) as described in "A Set of Instructions for 
Operating on Packed Data filed on Aug. 31, 1995, application number 521,360. Packed 
instruction set 140 may also include one or more instructions for supporting: a move data 
operation; a data shuffle operation for organizing data within a data storage device; a 
horizontal-add instruction for adding adjacent bytes, words and doublewords, two word 
values, two words to produce a 16-bit result, two quadwords to produce a quadword result; 
and a register merger operation as are described in "An Apparatus and Method for 
Efficient Filtering and Convolution of Content Data ," filed on Oct. 29, 2001, application 
serial number 09/952,891. 

[0043] Execution unit 130 is coupled to register file 150 by internal bus 170. Register 
file 150 represents a storage area on processor 109 for storing information, including data. 
It is understood that one aspect of the invention is the described instruction set for 
operating on packed data. According to this aspect of the invention, the storage area used 
for storing the packed data is not critical. However, embodiments of the register file 150 
are later described with reference to Figures 2a-2b. Execution unit 130 is coupled to cache 
160 and decoder 165. Cache 160 is used to cache data and/or control signals from, for 
example, main memory 104. Decoder 165 is used for decoding instructions received by 
processor 109 into control signals and/or microcode entry points. In response to these 
control signals and/or microcode entry points, execution unit 130 performs the appropriate 
operations. For example, if an add instruction is received, decoder 165 causes execution 
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unit 130 to perform the required addition; if a subtract instruction is received, decoder 165 
causes execution unit 130 to perform the required subtraction; etc. Decoder 165 may be 
implemented using any number of different mechanisms (e.g., a look-up table, a hardware 
implementation, a PLA, etc.). Thus, while the execution of the various instructions by the 
decoder and execution unit is represented by a series of if/then statements, it is understood 
that the execution of an instruction does not require a serial processing of these if/then 
statements. Rather, any mechanism for logically performing this if/then processing is 
considered to be within the scope of the invention. 

[0044] Figure la additionally shows a data storage device 107(e.g., a magnetic disk, 
optical disk, and/or other machine readable media) can be coupled to computer system 
100. In addition, the data storage device 107 is shown including code 195 for execution by 
the processor 109. The code 195 can be written to cause the processor 109 to perform 
transformations, filters or convolutions with the multiply-add/subtract instruction(s) for 
any number of purposes (e.g., motion video compression/decompression, image filtering, 
audio signal compression, filtering or synthesis, modulation/demodulation, etc.). 
Computer system 100 can also be coupled via bus 101 to a display device 121 for 
displaying information to a computer user. Display device 121 can include a frame buffer, 
specialized graphics rendering devices, a cathode ray tube (CRT), and/or a flat panel 
display. An alphanumeric input device 122, including alphanumeric and other keys, is 
typically coupled to bus 101 for communicating information and command selections to 
processor 109. Another type of user input device is cursor control 123, such as a mouse, a 
trackball, a pen, a touch screen, or cursor direction keys for communicating direction 
information and command selections to processor 109, and for controlling cursor 
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movement on display device 121. This input device typically has two degrees of freedom 
in two axes, a first axis (e.g., x) and a second axis (e.g., y), which allows the device to 
specify positions in a plane. However, this invention should not be limited to input devices 
with only two degrees of freedom. 

[0045] Another device which may be coupled to bus 101 is a hard copy device 124 
which may be used for printing instructions, data, or other information on a medium such 
as paper, film, or similar types of media. Additionally, computer system 100 can be 
coupled to a device for sound recording, and/or playback 125, such as an audio digitizer 
coupled to a microphone for recording information. Further, the device may include a 
speaker which is coupled to a digital to analog (D/A) converter for playing back the 
digitized sounds. 

[0046] Also, computer system 100 can be a terminal in a computer network (e.g., a 
LAN). Computer system 100 would then be a computer subsystem of a computer network. 
Computer system 100 optionally includes video digitizing device 126 and/or a 
communications device 190 (e.g., a serial communications chip, a wireless interface, an 
ethernet chip or a modem, which provides communications with an external device or 
network). Video digitizing device 126 can be used to capture video images that can be 
transmitted to others on the computer network. 

[0047] In one embodiment, the processor 109 additionally supports an instruction set 
which is compatible with the x86 instruction set used by existing processors (such as the 

Pentium® processor) manufactured by Intel Corporation of Santa Clara, California. Thus, 

in one embodiment, processor 109 supports all the operations supported in the IA™ - Intel 

Architecture, as defined by Intel Corporation of Santa Clara, California (see "IA-32 Intel® 
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Architecture Software Developers Manual Volume 2: Instruction Set Reference," Order 
Number 245471, available from Intel of Santa Clara, California on the world wide web at 
developer.intel.com). As a result, processor 109 can support existing x86 operations in 
addition to the operations of the invention. Processor 109 may also be suitable for 
manufacture in one or more process technologies and by being represented on a machine 
readable media in sufficient detail, may be suitable to facilitate said manufacture. While 
the invention is described as being incorporated into an x86 based instruction set, 
alternative embodiments could incorporate the invention into other instruction sets. For 
example, the invention could be incorporated into a 64-bit processor using a new 
instruction set. 

[0048] Figure lb illustrates an alternative embodiment of a data processing system 
102 which implements the principles of the present invention. One embodiment of data 
processing system 102 is an Intel® Personal Internet Client Architecture (Intel® PCA) 
applications processors with Intel XScale™ technology (as described on the world-wide 
web at developer.intel.com). It will be readily appreciated by one of skill in the art that the 
embodiments described herein can be used with alternative processing systems without 
departure from the scope of the invention. 

[0049] Computer system 102 comprises a processing core 110 capable of performing 
SIMD operations including multiplications and horizontal additions and/or subtractions. 
For one embodiment, processing core 110 represents a processing unit of any type of 
architecture, including but not limited to a CISC, a RISC or a VLIW type architecture. 
Processing core 110 may also be suitable for manufacture in one or more process 
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technologies and by being represented on a machine readable media in sufficient detail, 
may be suitable to facilitate said manufacture. 

[0050] Processing core 1 10 comprises an execution unit 130, a set of register file(s) 
150, and a decoder 165. Processing core 110 also includes additional circuitry (not shown) 
which is not necessary to the understanding of the present invention. 
[0051] Execution unit 130 is used for executing instructions received by processing 
core 110. In addition to recognizing typical processor instructions, execution unit 220 
recognizes instructions in packed instruction set 140 for performing operations on packed 
data formats. Packed instruction set 140 includes instructions for supporting multiply- 
add/subtract operations, horizontal-add operations, and may also include other packed 
instructions. 

[0052] Execution unit 130 is coupled to register file 150 by an internal bus. Register 
file 150 represents a storage area on processing core 1 10 for storing information, including 
data. As previously mentioned, it is understood that the storage area used for storing the 
packed data is not critical. Execution unit 130 is coupled to decoder 165. Decoder 165 is 
used for decoding instructions received by processing core 1 10 into control signals and/or 
microcode entry points. In response to these control signals and/or microcode entry points, 
execution unit 130 performs the appropriate operations. 

[0053] Processing core 1 10 is coupled with bus 214 for communicating with various 
other system devices, which may include but are not limited to, for example, synchronous 
dynamic random access memory (SDRAM) control 271, static random access memory 
(SRAM) control 272, burst flash memory interface 273, personal computer memory card 
international association (PCMCIA)/compact flash (CF) card control 274, liquid crystal 
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display (LCD) control 275, direct memory access (DMA) controller 276, and alternative 
bus master interface 277. 

[0054] In one embodiment, data processing system 102 may also comprise an I/O 
bridge 290 for communicating with various I/O devices via an I/O bus 295. Such I/O 
devices may include but are not limited to, for example, universal asynchronous 
receiver/transmitter (UART) 291, universal serial bus (USB) 292, Bluetooth wireless 
UART 293 and I/O expansion interface 294. 

[0055] One embodiment of data processing system 102 provides for mobile, network 
and/or wireless communications and a processing core 110 capable of performing SIMD 
operations including multiply add and/or subtract operations, horizontal-addition and/or 
subtraction, pack and unpack operations, shuffle operations, packed shift operations, and 
packed arithmetic and logical operations. Processing core 1 10 may be programmed with 
various audio, video, imaging and communications algorithms including discrete 
transformations, filters or convolutions; compression/decompression techniques such as 
color space transformation, video encode motion estimation or video decode motion 
compensation; and modulation/demodulation (MODEM) functions such as pulse coded 
modulation (PCM). 

[0056] Figure lc illustrates alternative embodiments of a data processing system 103 
capable of performing SIMD multiply-add/subtract and horizontal-add/subtract operations. 
In accordance with one alternative embodiment, data processing system 103 may include a 
main processor 224, a SIMD coprocessor 226, a cache memory 278 and an input/output 
system 265. The input/output system 295 may optionally be coupled to a wireless 
interface 296. SIMD coprocessor 226 is capable of performing SIMD operations including 
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multiply-add/subtract operations, horizontal-acid/subtract operations, pack and unpack 
operations, shuffle operations, packed shift operations, and packed arithmetic and logical 
operations. Processing core 1 10 may be suitable for manufacture in one or more process 
technologies and by being represented on a machine readable media in sufficient detail, 
may be suitable to facilitate the manufacture of all or part of data processing system 103 
including processing core 110. 

[0057] For one embodiment, SIMD coprocessor 226 comprises an execution unit 130 
and register file(s) 209. One embodiment of main processor 224 comprises a decoder 165 
to recognize instructions of instruction set 140 including SIMD multiply-add/subtract 
instructions, horizontal-add/subtract instructions, pack and unpack instructions, shuffle 
instructions, packed shift instructions, and packed arithmetic and logical instructions for 
execution by execution unit 130. For alternative embodiments, SIMD coprocessor 226 
also comprises at least part of decoder 165b to decode instructions of instruction set 140. 
Processing core 110 also includes additional circuitry (not shown) which is not necessary 
to the understanding of the present invention. 

[0058] In operation, the main processor 224 executes a stream of data processing 
instructions that control data processing operations of a general type including interactions 
with the cache memory 278, and the input/output system 295. Embedded within the 
stream of data processing instructions are SIMD coprocessor instructions. The decoder 
165 of main processor 224 recognizes these SIMD coprocessor instructions as being of a 
type that should be executed by an attached SIMD coprocessor 226. Accordingly, the 
main processor 224 issues these SIMD coprocessor instructions (or control signals 
representing SIMD coprocessor instructions) on the coprocessor bus 236 where from they 
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are received by any attached SIMD coprocessors. In this case, the SMD coprocessor 226 
will accept and execute any received SIMD coprocessor instructions intended for it. 
[0059] Data may be received via wireless interface 296 for processing by the SIMD 
coprocessor instructions. For one example, voice communication may be received in the 
form of a digital signal, which may be processed by the SIMD coprocessor instructions to 
regenerate digital audio samples representative of the voice communications. For another 
example, compressed audio and/or video may be received in the form of a digital bit 
stream, which may be processed by the SIMD coprocessor instructions to regenerate 
digital audio samples and/or motion video frames. 

[0060] For one embodiment of processing core 110, main processor 224 and a SIMD 
coprocessor 226 are integrated into a single processing core 1 10 comprising an execution 
unit 130, register file(s) 209, and a decoder 165 to recognize instructions of instruction set 
140 including SIMD multiply-add/subtract instructions, horizontal-add/subtract 
instructions, pack and unpack instructions, shuffle instructions, packed shift instructions, 
and packed arithmetic and logical instructions for execution by execution unit 130. 
[0061] Figure 2a illustrates the register file of the processor according to one 
embodiment of the invention. The register file 150 may be used for storing information, 
including control/status information, integer data, floating point data, and packed data. In 
the embodiment shown in Figure 2a, the register file 150 includes integer registers 201, 
registers 209, status registers 208, and instruction pointer register 211. Status registers 208 
indicate the status of processor 109. Instruction pointer register 21 1 stores the address of 
the next instruction to be executed. Integer registers 201, registers 209, status registers 208, 
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and instruction pointer register 21 1 are all coupled to internal bus 170. Additional 
registers may also be coupled to internal bus 170. 

[0062] In one embodiment, the registers 209 are used for both packed data and floating 
point data. In one such embodiment, the processor 109, at any given time, must treat the 
registers 209 as being either stack referenced floating point registers or non-stack 
referenced packed data registers. In this embodiment, a mechanism is included to allow 
the processor 109 to switch between operating on registers 209 as stack referenced floating 
point registers and non-stack referenced packed data registers. In another such 
embodiment, the processor 109 may simultaneously operate on registers 209 as non-stack 
referenced floating point and packed data registers. As another example, in another 
embodiment, these same registers may be used for storing integer data. 
[0063] Of course, alternative embodiments may be implemented to contain more or 
less sets of registers. For example, an alternative embodiment may include a separate set 
of floating point registers for storing floating point data. As another example, an 
alternative embodiment may including a first set of registers, each for storing control/status 
information, and a second set of registers, each capable of storing integer, floating point, 
and packed data. As a matter of clarity, the registers of an embodiment should not be 
limited in meaning to a particular type of circuit. Rather, a register of an embodiment need 
only be capable of storing and providing data, and performing the functions described 
herein. 

[0064] The various sets of registers (e.g., the integer registers 201, the registers 209) 
may be implemented to include different numbers of registers and/or to different size 
registers. For example, in one embodiment, the integer registers 201 are implemented to 
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store thirty-two bits, while the registers 209 are implemented to store eighty bits (all eighty 
bits are used for storing floating point data, while only sixty-four are used for packed data). 
In addition, registers 209 contains eight registers, Ro 212a through R7 212h. Ri 212a, R2 
212b and R3 212c are examples of individual registers in registers 209. Thirty-two bits of 
a register in registers 209 can be moved into an integer register in integer registers 201. 
Similarly, a value in an integer register can be moved into thirty-two bits of a register in 
registers 209. In another embodiment, the integer registers 201 each contain 64 bits, and 
64 bits of data may be moved between the integer register 201 and the registers 209. In 
another alternative embodiment, the registers 209 each contain 64 bits and registers 209 
contains sixteen registers. In yet another alternative embodiment, registers 209 contains 
thirty-two registers. 

[0065] Figure 2b illustrates the register file of the processor according to one 
alternative embodiment of the invention. The register file 150 may be used for storing 
information, including control/status information, integer data, floating point data, and 
packed data. In the embodiment shown in Figure 2b, the register file 150 includes integer 
registers 201, registers 209, status registers 208, extension registers 210, and instruction 
pointer register 21 1. Status registers 208, instruction pointer register 211, integer registers 
201, registers 209, are all coupled to internal bus 170. Additionally, extension registers 
210 are also coupled to internal bus 170. 

[0066] In one embodiment, the extension registers 210 are used for both packed 
integer data and packed floating point data. In alternative embodiments, the extension 
registers 210 may be used for scalar data, packed Boolean data, packed integer data and/or 
packed floating point data. Of course, alternative embodiments may be implemented to 
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contain more or less sets of registers, more or less registers in each set or more or less data 
in each register without departing from the broader scope of the invention. 
[0067] In one embodiment, the integer registers 201 are implemented to store thirty- 
two bits, the registers 209 are implemented to store eighty bits (all eighty bits are used for 
storing floating point data, while only sixty-four are used for packed data) and the 
extension registers 210 are implemented to store 128 bits. In addition, extension registers 
210 may contain eight registers, XRo 213a through XR7 213h. XRi 213a, XR2 213b and 
R3 213c are examples of individual registers in registers 210. In another embodiment, the 
integer registers 201 each contain 64 bits, the registers 210 each contain 64 bits and 
registers 210 contains sixteen registers. In one embodiment two registers of registers 210 
may be operated upon as a pair. In yet another alternative embodiment, registers 210 
contains thirty-two registers. 

[0068] Figure 3 illustrates a flow diagram for one embodiment of a process 300 to 
manipulate data according to one embodiment of the invention. That is, Figure 3 
illustrates the a process followed, for example, by processor 109 while performing an 
operation on packed data, performing an operation on unpacked data, or performing some 
other operation. Process 300 and other processes herein disclosed are performed by 
processing blocks that may comprise dedicated hardware or software or firmware 
operation codes executable by general purpose machines or by special purpose machines 
or by a combination of both. 

[0069] In processing block 301, the decoder 165 receives a control signal from either 
the cache 160 or bus 101. Decoder 165 decodes the control signal to determine the 
operations to be performed. 
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[0070] In processing block 302, Decoder 165 accesses the register file 150, or a 
location in memory. Registers in the register file 150, or memory locations in the memory, 
are accessed depending on the register address specified in the control signal. For example, 
for an operation on packed data, the control signal can include SRC1, SRC2 and DEST 
register addresses. SRC1 is the address of the first source register. SRC2 is the address of 
the second source register. In some cases, the SRC2 address is optional as not all 
operations require two source addresses. If the SRC2 address is not required for an 
operation, then only the SRC1 address is used. DEST is the address of the destination 
register where the result data is stored. In one embodiment, SRC1 or SRC2 is also used as 
DEST. SRC1, SRC2 and DEST are described more fully in relation to Figures 6a-6d. The 
data stored in the corresponding registers is referred to as Sourcel, Source2, and Result 
respectively. In one embodiment, each of these data may be sixty-four bits in length. In an 
alternative embodiment, these data may be sixty-four or one hundred twenty-eight bits in 
length. 

[0071] In another embodiment of the invention, any one, or all, of SRC1, SRC2 and 
DEST, can define a memory location in the addressable memory space of processor 109 or 
processing core 110. For example, SRC1 may identify a memory location in main memory 
104, while SRC2 identifies a first register in integer registers 201 and DEST identifies a 
second register in registers 209. For simplicity of the description herein, the invention will 
be described in relation to accessing the register file 150. However, these accesses could 
be made to memory instead. 
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[0072] In processing block 303, execution unit 130 is enabled to perform the operation 
on the accessed data. In processing block 304, the result is stored back into register file 
150 according to requirements of the control signal. 

Data Storage Formats 
[0073] Figure 4a illustrates packed data-types according to one embodiment of the 
invention. Three packed data formats are illustrated; packed byte 411, packed word 412, 
and packed doubleword 413. Packed byte, in one embodiment of the invention, is sixty- 
four bits long containing eight data elements. In an alternative embodiment, packed byte 
may be sixty-four or one hundred twenty-eight bits long containing eight or sixteen data 
elements. Each data element is one byte long. Generally, a data element is an individual 
piece of data that is stored in a single register (or memory location) with other data 
elements of the same length. In one embodiment of the invention, the number of data 
elements stored in a register is sixty-four bits or one hundred twenty-eight bits divided by 
the length in bits of a data element. 

[0074] Packed word 412 may be sixty-four or one hundred twenty-eight bits long and 
contains four or eight word 412 data elements. Each word 412 data element contains 
sixteen bits of information. 

[0075] Packed doubleword 413 may be sixty-four or one hundred twenty-eight bits 
long and contains two or four doubleword 413 data elements. Each doubleword 413 data 
element contains thirty-two bits of information. 

[0076] Figure 4a also illustrates a quadword 414 data-type according to one 
embodiment of the invention. Each quadword 414 data element contains sixty-four bits of 
information. 
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[0077] Figure 4b illustrates packed data-types according to one alternative 
embodiment of the invention. Four packed data formats are illustrated; packed byte 421, 
packed half 422, packed single 423 and packed double 424. Packed byte, in one 
embodiment of the invention, is one hundred twenty-eight bits long containing sixteen data 
elements. In an alternative embodiment, packed byte may be sixty-four or one hundred 
twenty-eight bits long containing eight or sixteen data elements. Each data element is one 
byte long. 

[0078] Packed half 422 may be sixty-four or one hundred twenty-eight bits long and 
contains four or eight half 422 data elements. Each half 422 data element contains sixteen 
bits of information. 

[0079] Packed single 423 may be sixty-four or one hundred twenty-eight bits long and 
contains two or four single 423 data elements. Each single 423 data element contains 
thirty-two bits of information. 

[0080] Packed double 424 may be sixty-four or one hundred twenty-eight bits long and 
contains one or two double 424 data elements. Each double 424 data element contains 
sixty-four bits of information. 

[0081] In one embodiment of the invention, packed single 423 and packed double 424 
may be packed floating point data elements. In an alternative embodiment of the 
invention, packed single 423 and packed double 424 may be packed integer, packed 
Boolean or packed floating point data elements. In another alternative embodiment of the 
invention, packed byte 421, packed half 422, packed single 423 and packed double 424 
may be packed integer or packed Boolean data elements. In alternative embodiments of 
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the invention, not all of the packed byte 421, packed half 422, packed single 423 and 
packed double 424 data formats may be permitted. 

[0082] Figures 5a-5d illustrate the in-register packed data storage representation 
according to one embodiment of the invention. Unsigned packed byte in-register 
representation 510 illustrates the storage of an unsigned packed byte, for example in one of 
the registers Ro 212a through R7 212h or in half of one of the registers XRo 213a through 
XR7 213h. Information for each byte data element is stored in bit seven through bit zero 
for byte zero, bit fifteen through bit eight for byte one, bit twenty-three through bit sixteen 
for byte two, bit thirty-one through bit twenty-four for byte three, bit thirty-nine through bit 
thirty-two for byte four, bit forty-seven through bit forty for byte five, bit fifty-five through 
bit forty-eight for byte six and bit sixty-three through bit fifty-six for byte seven. Thus, all 
available bits are used in the register. This storage arrangement increases the storage 
efficiency of the processor. As well, with eight data elements accessed, one operation can 
now be performed on eight data elements simultaneously. Signed packed byte in-register 
representation 511 illustrates the storage of a signed packed byte. Note that the eighth bit 
of every byte data element is the sign indicator. 

[0083] Unsigned packed word in-register representation 512 illustrates how word three 
through word zero are stored in one register of registers 209 or in half of a register of 
registers 210. Bit fifteen through bit zero contain the data element information for word 
zero, bit thirty-one through bit sixteen contain the information for data element word one, 
bit forty-seven through bit thirty-two contain the information for data element word two 
and bit sixty-three through bit forty-eight contain the information for data element word 
three. Signed packed word in-register representation 513 is similar to the unsigned packed 
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word in-register representation 512. Note that the sixteenth bit of each word data element 
is the sign indicator. 

[0084] Unsigned packed doubleword in-register representation 514 shows how 
registers 209 or registers 210, for example, store two doubleword data elements. 
Doubleword zero is stored in bit thirty-one through bit zero of the register. Doubleword 
one is stored in bit sixty-three through bit thirty-two of the register. Signed packed 
doubleword in-register representation 515 is similar to unsigned packed doubleword in- 
register representation 514. Note that the necessary sign bit is the thirty-second bit of the 
doubleword data element. 

[0085] Unsigned packed quadword in-register representation 516 shows how registers 
210 store two quadword data elements. Quadword zero is stored in bit sixty-three through 
bit zero of the register. Quadword one is stored in bit one hundred twenty-seven through 
bit sixty-four of the register. Signed packed quadword in-register representation 517 is 
similar to unsigned packed quadword in-register representation 516. Note that the 
necessary sign bit is the sixty-fourth bit of the quadword data element. 
[0086] As mentioned previously, registers 209 may be used for both packed data and 
floating point data. In this embodiment of the invention, the individual programming 
processor 109 may be required to track whether an addressed register, Ro 212a for 
example, is storing packed data or floating point data. In an alternative embodiment, 
processor 109 could track the type of data stored in individual registers of registers 209. 
This alternative embodiment could then generate errors if, for example, a packed addition 
operation were attempted on floating point data. 
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Operation Encoding Formats 
[0087] Turning next to Figure 6a, in some alternative embodiments, 64 bit single 
instruction multiple data (SIMD) arithmetic operations may be performed through a 
coprocessor data processing (CDP) instruction. Operation encoding (opcode) format 601 
depicts one such CDP instruction having CDP opcode fields 61 1 and 618. The type of 
CDP instruction, for alternative embodiments of multiply-add/subtract operations, may be 
encoded by one or more of fields 612, 613, 616 and 617. Up to three operand locations per 
instruction may be identified, including up to two source operand identifiers SRC1 602 
and SRC2 603 and one destination operand identifier DEST 605. One embodiment of the 
coprocessor can operate on 8, 16, 32, and 64 bit values. For one embodiment, the 
multiply-addition/subtraction is performed on fixed-point or integer data values. For 
alternative embodiments, multiply-addition/subtraction may be performed on floating- 
point data values. In some embodiments, the multiply-add/subtract instructions may be 
executed conditionally, using condition field 610. For some multiply-add/subtract 
instructions source data sizes may be encoded by field 612. 

[0088] In some embodiments of the multiply-add/subtract instructions, Zero (Z), 
negative (N), carry (C), and overflow (V) detection can be done on SIMD fields. Also, 
signed saturation and/or unsigned saturation to the SIMD field width may be performed for 
some embodiments of multiply-add/subtract operations and horizontal-add/subtract 
operations. In some embodiments of the multiply-add/subtract instructions and horizontal- 
add/subtract operations in which saturation is enabled, saturation detection may also be 
done on SIMD fields. For some instructions, the type of saturation may be encoded by 

field 613. For other instructions, the type of saturation may be fixed. 
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[0089] Figure 6b is a depiction of an alternative operation encoding (opcode) format 
621, having twenty-four or more bits, and register/memory operand addressing modes 
corresponding with a type of opcode format described in the "IA-32 Intel Architecture 
Software Developer's Manual Volume 2: Instruction Set Reference," (Order number 
245471) which is available from Intel Corporation, Santa Clara, CA on the world-wide- 
web (www) at developer.intel.com. The type of operation may be encoded by one or more 
of fields 622 and 624. Up to two operand locations per instruction may be identified, 
including up to two source operand identifiers SRC1 602 and SRC2 603. For one 
embodiment of the multiply-add/subtract instruction and the horizontal-add/subtract 
instruction, destination operand identifier DEST 605 is the same as source operand 
identifier SRC1 602. For an alternative embodiment, destination operand identifier DEST 
605 is the same as source operand identifier SRC2 603. Therefore, for embodiments of the 
multiply-add/subtract operations and horizontal add/subtract operations, one of the source 
operands identified by source operand identifiers SRC1 602 and SRC2 603 is overwritten 
by the results of the multiply-add/subtract operations and horizontal add/subtract 
operations. For one embodiment of the multiply-add/subtract instruction and horizontal 
add/subtract instruction, operand identifiers SRC1 602 and SRC2 603 may be used to 
identify 64-bit source and destination operands. 

[0090] Figure 6c is a depiction of an alternative operation encoding (opcode) format 

631, having thirty-two or more bits, and register/memory operand addressing modes. The 

type of operation may be encoded by one or more of fields 632 and 634 and up to two 

operand locations per instruction may be identified, including up to two source operand 

identifiers SRC1 602 and SRC2 603. For example, in one embodiment of the multiply- 
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add instruction, field 632 may be set to a hexadecimal value of 0F38 and field 634 may be 
set to a hexadecimal value of 04 to indicate that data associated with source operand 
identifier SRC1 602 is to be treated as unsigned packed bytes, data associated with source 
operand identifier SRC2 603 is to be treated as signed packed bytes and result data 
associated with destination operand identifier DEST 605 is to be treated as signed packed 
words. 

[0091] For one embodiment, destination operand identifier DEST 605 is the same as 
source operand identifier SRC1 602. For an alternative embodiment, destination operand 
identifier DEST 605 is the same as source operand identifier SRC2 603. For one 
embodiment of the multiply-add/subtract instruction, operand identifiers SRC1 602 and 
SRC2 603 of opcode format 631 may be used to identify 64-bit source and destination 
operands. For an alternative embodiment of the multiply-add/subtract instruction, operand 
identifiers SRC1 602 and SRC2 603 may be used to identify 128-bit source and destination 
operands. 

[0092] In one embodiment of the horizontal-add instruction, field 632 may be set to a 
hexadecimal value of 0F38 and field 634 may be set to a hexadecimal value of 01 to 
indicate that data associated with source operand identifiers 602 and 603 are to be treated 
as signed packed words and result data associated with destination operand identifier 605 
are to be treated as signed packed words. For an alternative embodiment of the horizontal- 
add instruction, field 614 may be set to a hexadecimal value of 03 to indicate that result 
data associated with destination operand identifier 605 are to be saturated to signed word 
values. For another alternative embodiment of the horizontal-add instruction, field 614 
may be set to a hexadecimal value of 02 to indicate that data associated with source 
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operand identifiers 602 and 603 are to be treated as signed packed doublewords and result 
data associated with destination operand identifier 605 are to be treated as signed packed 
doublewords. 

[0093] For one embodiment of the horizontal-subtract instruction, field 614 may be set 
to a hexadecimal value of 05 to indicate that data associated with source operand 
identifiers 602 and 603 are to be treated as signed packed words and result data associated 
with destination operand identifier 605 are to be treated as signed packed words. For an 
alternative embodiment of the horizontal-subtract instruction, field 614 may be set to a 
hexadecimal value of 07 to indicate that result data associated with destination operand 
identifier 605 are to be saturated to signed word values. For another alternative 
embodiment of the horizontal-subtract instruction, field 614 may be set to a hexadecimal 
value of 06 to indicate that data associated with source operand identifiers 602 and 603 are 
to be treated as signed packed doublewords and result data associated with destination 
operand identifier 605 are to be treated as signed packed doublewords. 
[0094] For one embodiment of the horizontal-add/subtract instruction, prefix byte 610 
may be used to identify 128-bit source and destination operands. For example, in one 
embodiment of the horizontal-add/subtract instruction, field 610 may be set to a 
hexadecimal value of 66 to indicate that 128 bits of data are associated with source 
operand identifiers 602 and 603 and 128 bits of result data are associated with destination 
operand identifier 605. For one embodiment of the horizontal-add/subtract instruction, 
destination operand identifier 605 is the same as source operand identifier 602. For an 
alternative embodiment, destination operand identifier 605 is the same as source operand 
identifier 603. Therefore, for embodiments of the horizontal-add/subtract operations, one 
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of the source operands identified by source operand identifiers 602 and 603 is overwritten 
by the results of the horizontal-add/subtract operations. 

[0095] For one embodiment, opcode format 621, opcode format 631 and other opcode 
formats described in the "IA-32 Intel Architecture Software Developer's Manual Volume 
2: Instruction Set Reference," (available from Intel Corporation, Santa Clara, CA on the 
world-wide-web at developer.intel.com) are each supported by decoder 165. In alternative 
embodiments of decoder 165, a plurality of instructions, each potentially having a different 
opcode format, may be decoded concurrently or in parallel. It will be appreciated that the 
decoding of opcode formats in a timely manner may be of critical importance to the 
performance of a processor such as processor 109. One of the unique requirements of 
decoding multiple opcode formats of variable lengths is determining precisely where each 
instruction begins. In order to accomplish this requirement, the lengths of each of the 
plurality of opcode formats must be determined. 

[0096] For example, in one embodiment of opcode format 621, determining the length 
of an instruction requires examination of up to 27 bits from fields 622, 624, 626, 602, 603 
and potentially from a 3-bit base field of an optional scale-index-base (SIB) byte (not 
shown), which is described in the "IA-32 Intel Architecture Software Developer's Manual 
Volume 2: Instruction Set Reference." It will be appreciated that, if determining the length 
of an instruction using opcode format 631 requires examination of more bits than 
determining the length of an instruction using opcode format 621, additional complexity 
and/or delays may be incurred. 

[0097] For one embodiment of the multiply-add instruction and the horizontal-add 
instruction, field 632 may be set to a hexadecimal value of 0F38, which may be used in a 
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manner substantially similar to that of fields 622 in determining the length of an 
instruction. Further, when field 632 is set to the hexadecimal value of 0F38, field 634 may 
be ignored by decoder 165 in determining the length of the instruction, thereby requiring 
examination of no more than 27 bits from fields 632, 626, 602, 603 and potentially from 
the 3-bit base field of an optional SIB byte. Thus opcode format 631 may be implemented 
in such a way as to provide additional flexibility and diversity of instruction encodings and 
avoid introduction of unnecessary complexity and/or delays in decoder 165. 
[0098] Figure 6d is a depiction of another alternative operation encoding (opcode) 
format 641, having forty or more bits. Opcode format 641 corresponds with opcode 
format 631 and comprises an optional prefix byte 640. The type of multiply- add/subtract 
operation and/or horizontal-add/subtract operation, may be encoded by one or more of 
fields 640, 632 and 634. Up to two operand locations per instruction may be identified by 
source operand identifiers SRC1 602 and SRC2 603 and by prefix byte 640. For one 
embodiment of the multiply-add/subtract instruction and/or horizontal-add/subtract 
instruction, prefix byte 640 may be used to identify 128-bit source and destination 
operands. For example, in one embodiment of the multiply-add instruction and/or 
horizontal-add/subtract instruction, prefix byte 640 may be set to a hexadecimal value of 
66, to indicate that 128 bits of data from one of the extension registers 210 are associated 
with source operand identifiers SRC1 602 and SRC2 603 and 128 bits of result data from 
one of the extension registers 210 are associated with destination operand identifier DEST 
605. 

[0099] For one embodiment of the multiply-add/subtract instruction and/or horizontal- 
add/subtract instruction, destination operand identifier DEST 605 is the same as source 
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operand identifier SRC1 602. For an alternative embodiment, destination operand 
identifier DEST 605 is the same as source operand identifier SRC2 603. Therefore, for 
embodiments of the multiply-add/subtract operations and/or horizontal-add/subtract 
operations, one of the source operands identified by source operand identifiers SRC1 602 
and SRC2 603 of opcode format 631 or opcode format 641 is overwritten by the results of 
the multiply-add/subtract operations or horizontal-add/subtract operations. Opcode 
formats 621, 631 and 641 allow register to register, memory to register, register by 
memory, register by register, register by immediate, register to memory addressing 
specified in part by MOD fields 626 and by optional scale-index-base and displacement 
bytes. 

DESCRIPTION OF SATURATE/UNSATURATE 
[0100] As mentioned previously, in some embodiments multiply-add/subtract opcodes 
may indicate whether operations optionally saturate. In some alternative embodiments 
saturation may not be optional for a given multiply-add/subtract instruction or horizontal- 
add/subtract instruction,. Where the result of an operation, with saturate enabled, 
overflows or underflows the range of the data, the result will be clamped. Clamping means 
setting the result to a maximum or minimum value should a result exceed the range's 
maximum or minimum value. In the case of underflow, saturation clamps the result to the 
lowest value in the range and in the case of overflow, to the highest value. The allowable 
range for each data format is shown in Table 5. 
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Data Format 


Minimum Value 


Maximum Value 


Unsigned Byte 


0 


255 


Signed Byte 


-128 


127 


Unsigned word 


0 


65535 


Signed word 


-32768 


32767 


Unsigned Doubleword 


0 


232-1 


Signed Doubleword 


-231 


231-1 


Unsigned Quadword 


0 


264-1 


Signed Quadword 


_ 2 63 


263-1 



Table 5 

[0101] Therefore, using the unsigned byte data format, if an operation's result = 258 
and saturation was enabled, then the result would be clamped to 255 before being stored 
into the operation's destination register. Similarly, if an operation's result = -32999 and 
processor 109 used signed word data format with saturation enabled, then the result would 
be clamped to -32768 before being stored into the operation's destination register. 

Multiply-Add/Subtract Operation(s) 
[0102] In one embodiment of the invention, the SRC1 register contains packed data 
(Source 1), the SRC2 register contains packed data (Source2), and the DEST register will 
contain the result (Result) of performing the multiply-add or multiply-subtract instruction 
on Sourcel and Source2. In the first step of the multiply-add and multiply-subtract 
instruction, Sourcel will have each data element independently multiplied by the 
respective data element of Source2 to generate a set of respective intermediate results. 
These intermediate results are summed by pairs to generate the Result for the multiply-add 
instruction. In contrast, these intermediate results are subtracted by pairs to generate the 
Result for the multiply-subtract instruction. 
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[0103] In some current processors, the multiply-add and multiply-subtract instructions 
operate on signed packed data and truncate the results to avoid any overflows. In addition, 
these instructions operate on packed word data and the Result is a packed double word. 
However, alternative embodiments could support these instructions for other packed data 
types. For example, an alternative embodiment may support the multiply-add or the 
multiply-subtract instructions on packed byte data wherein the Result is a packed word. 
[0104] Figure 7a is illustrates a flow diagram for one embodiment of a process 700 for 
performing multiply-add and multiply-subtract operations on packed data according to one 
embodiment of the invention. Process 700 and other processes herein disclosed are 
performed by processing blocks that may comprise dedicated hardware or software or 
firmware operation codes executable by general purpose machines or by special purpose 
machines or by a combination of both. 

[0105] In processing block 701, decoder 165 decodes the control signal received by 
processor 109. Thus, decoder 165 decodes the operation code for a multiply-add 
instruction. 

[0106] In processing block 702, via internal bus 170, decoder 165 accesses registers 
209 in register file 150 given the SRC1 602 and SRC2 603 addresses. Registers 209 
provide execution unit 130 with the packed data stored in the SRC1 602 register 
(Source 1), and the packed data stored in SRC2 603 register (Source2). That is, registers 
209 (or extension registers 210) communicate the packed data to execution unit 130 via 
internal bus 170. As noted above, Source 1 data and Source2 data may be accessed from 
memory as well as from registers 209 (or extension registers 210) and the term "register" 
as used in these examples is not intended to limit the access to any particular kind of 
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storage device. Rather, various embodiments, for example opcode formats 621, 631 and 
641, allow register to register, memory to register, register by memory, register by register, 
register by immediate, register to memory addressing. Therefore, a register of an 
embodiment need only be capable of storing and providing data, and performing the 
functions described herein. 

[0107] In processing block 703, decoder 165 enables execution unit 130 to perform the 
instruction. If the instruction is a multiply-add instruction for processing byte data, flow 
passes to processing block 718. 

[0108] In processing block 718, the following is performed. Sourcel bits seven 
through zero are multiplied by Source2 bits seven through zero generating a first 16-bit 
intermediate result (Intermediate Result 1). Sourcel bits fifteen through eight are 
multiplied by Source2 bits fifteen through eight generating a second 16-bit intermediate 
result (Intermediate Result 2). Sourcel bits twenty-three through sixteen are multiplied by 
Source2 bits twenty-three through sixteen generating a third 16-bit intermediate result 
(Intermediate Result 3). Sourcel bits thirty-one through twenty-four are multiplied by 
Source2 bits thirty-one through twenty-four generating a fourth 16-bit intermediate result 
(Intermediate Result 4). Sourcel bits thirty-nine through thirty-two are multiplied by 
Source2 bits thirty-nine through thirty-two generating a fifth 16-bit intermediate result 
(Intermediate Result 5). Sourcel bits forty-seven through forty are multiplied by Source2 
bits forty-seven through forty generating a sixth 16-bit intermediate result (Intermediate 
Result 6). Sourcel bits fifty-five through forty-eight are multiplied by Source2 bits fifty- 
five through forty-eight generating a seventh 16-bit intermediate result (Intermediate 
Result 7). Sourcel bits sixty-three through fifty-six are multiplied by Source2 bits sixty- 

42P15771 -39- 



three through fifty-six generating an eighth 16-bit intermediate result (Intermediate Result 
8). Intermediate Result 1 is added to Intermediate Result 2 generating Result bits fifteen 
through zero, Intermediate Result 3 is added to Intermediate Result 4 generating Result 
bits thirty-one through sixteen, Intermediate Result 5 is added to Intermediate Result 6 
generating Result bits forty-seven through thirty-two, and Intermediate Result 7 is added to 
Intermediate Result 8 generating Result bits sixty-three through forty-eight. 
[0109] Processing of a multiply-subtract instruction on byte data is substantially the 
same as processing block 718, with the exception that Intermediate Result 1 and 
Intermediate Result 2 are subtracted to generate Result bits fifteen through zero, 
Intermediate Result 3 and Intermediate Result 4 are subtracted to generate Result bits 
thirty-one through sixteen, Intermediate Result 5 and Intermediate Result 6 are subtracted 
to generate Result bits forty-seven through thirty-two, and Intermediate Result 7 and 
Intermediate Result 8 are subtracted to generate Result bits sixty-three through forty-eight. 
Different embodiments may perform the multiplies and adds/subtracts serially, in parallel, 
or in some combination of serial and parallel operations. 
[0110] In processing block 720, the Result is stored in the DEST register. 
[0111] In one embodiment of processing block 718, byte elements of Sourcel are 
treated as unsigned values and byte elements of Source2 are treated as signed values 
during multiplication. In another embodiment of processing block 718, Intermediate 
Results 1-8 are added/subtracted using signed saturation. It will be appreciated that 
alternative embodiments of process 711 may implement additional processing blocks to 
support additional variations of the multiply-add or multiply-subtract instructions. 
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[0112] Figure 7b illustrates a flow diagram for an alternative embodiment of a process 
721 for performing multiply-add operation on packed data. Processing blocks 701 through 
703 are essentially the same as in process block 711, with the exception that in processing 
block 703, the instruction is a multiply-add instruction for performing byte multiplications 
on 128-bit packed data, and so flow passes to processing block 719. 
[0113] In processing block 719, the multiplication operations are substantially the 
same as processing block 718, with the exception that in similarity to Source 1 bits seven 
through zero being multiplied by Source2 bits seven through zero to generate a first 16-bit 
intermediate result (Intermediate Result 1) and so forth through Source 1 bits sixty-three 
through fifty-six being multiplied by Source2 bits sixty-three through fifty-six to generate 
an eighth 16-bit intermediate result (Intermediate Result 8), Source 1 bits seventy-one 
through sixty-four are also multiplied by Source2 bits seventy-one through sixty-four to 
generate a ninth 16-bit intermediate result (Intermediate Result 9) and so forth through 
Source 1 bits one hundred twenty-seven through one hundred and twenty which are 
multiplied by Source2 bits one hundred twenty-seven through one hundred and twenty to 
generate a sixteenth 16-bit intermediate result (Intermediate Result 16). Then Intermediate 
Results 1 and 2 are added generating Result bits fifteen through zero, and so forth with 
pairs of Intermediate Results 3 and 4, Intermediate Results 5 and 6, ...through 
Intermediate Results 15 and 16 which are added together respectively generating Result 
bits thirty-one through sixteen, Result bits forty-seven through thirty-two, ...through 
Result bits one hundred and twenty-seven through one hundred and twelve. 
[0114] Again, in processing block 720, the Result is stored in the DEST register. 
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[0115] It will be appreciated that alternative embodiments of processing blocks 718 or 
719 may perform multiplication operations on signed or unsigned data elements or on a 
combination of both. It will also be appreciated that alternative embodiments of 
processing blocks 718 or 719 may perform addition and/or subtraction operations with or 
without saturation on signed or unsigned intermediate results or on a combination of both. 

Packed Data Multiply- Add/Subtract Circuits 
[0116] In one embodiment, the multiply-add and multiply- subtract instructions can 
execute on multiple data elements in the same number of clock cycles as a single multiply 
on unpacked data. To achieve execution in the same number of clock cycles, parallelism 
may be used. That is, registers may be simultaneously instructed to perform the multiply- 
add/subtract operations on the data elements. This is discussed in more detail below. 
[0117] Figure 8a illustrates a circuit for performing multiply-add and/or multiply- 
subtract operations on packed data according to one embodiment of the invention. Figure 
8a depicts a first source, Sourcel[63:0] 831, and a second source, Source2[63:0] 833,. In 
one embodiment, the first and second sources are stored in N-bit long SIMD registers, 
such as for example 128-bit Intel® SSE2 XMM registers, or for example 64-bit MMX™ 
registers. For two pixel vectors 831 and 833, the multiply-add instruction implemented on 
such registers would give the following results, Result[63:0] 890, which are stored to the 
destination. Accordingly, the example shows an 8-bit byte to 16-bit word embodiment of 
a multiply-add instruction 142 (FIG. 1). For one alternative embodiment of the multiply- 
add instruction, bytes in one of the sources may be signed and in the other they may be 
unsigned. While in some specific examples, packed data sources and destinations may be 
represented as having 64-bits, it will be appreciated that the principals disclosed herein 
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may be extended to other conveniently selected lengths, such as 80-bits, 128-bits or 256- 
bits. 

[0118] For one alternative embodiment, a source register with unsigned data is also the 
destination register with the 16-bit multiply-accumulate results. One reason for such a 
choice is that in many implementations, pixel data may be unsigned and coefficients may 
be signed. Accordingly, it may preferable to overwrite the pixel data because the pixel 
data is less likely to be needed in future calculations. 

[0119] Operation control 800 outputs signals on Enable 880 to control operations 
performed by packed multiply-adder/subtracter 801. One embodiment of operation control 
800 may comprise, for example, a decoder 165 and an instruction pointer register 211. Of 
course, operation control 800 may also comprise additional circuitry which is not 
necessary to understanding the invention. Packed multiply-adder/subtracter 801 includes: 
8x8 multiply 802 through 8x8 multiply 809. 8x8 multiply 802 has 8-bit inputs AO of 
Sourcel 831 and B0 of Source2 833. 8x8 multiply 803 has 8-bit inputs Al and Bl. 8x8 
multiply 804 has 8-bit inputs A2 and B2. 8x8 multiply 805 has 8-bit inputs A3 and B3. 
8x8 multiply 806 has 8-bit inputs A4 and B4. 8x8 multiply 807 has 8-bit inputs A5 and 
B5. 8x8 multiply 808 has 8-bit inputs A6 and B6. 8x8 multiply 809 has 8-bit inputs A7 
and B7. The 16-bit intermediate results generated by 8x8 multiply 802 and 8x8 multiply 

803 are received by adder 852, the 16-bit intermediate results generated by 8x8 multiply 

804 and 8x8 multiply 805 are received by adder 854, the 16-bit intermediate results 
generated by 8x8 multiply 806 and 8x8 multiply 806 are received by adder 856 and the 16- 
bit intermediate results generated by 8x8 multiply 808 and 8x8 multiply 809 are received 
by adder 858. 
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[0120] Based on whether the current instruction is a multiply/add or multiply/subtract 
instruction, adder 852 through adder 858 add or subtract their respective 16-bit inputs. 
The output of adder 852 (i.e., bits 15 through 0 of the Result), the output of adder 854 (i.e., 
bits 31 through 16 of the Result), the output of adder 856 (i.e., bits 47 through 32 of the 
Result) and the output of adder 858 (i.e., bits 63 through 48 of the Result) are combined 
into a 64-bit packed result and communicated to Result[63:0] 890. 
[0121] Alternative embodiments of byte multiply-add/subtract instructions may 
include but are not limited to operations for unsigned packed bytes in both sources and 
operations for signed packed bytes in both sources. Some embodiments of multiply- 
add/subtract instructions may include operations that apply to pairs of 16-bit signed words 
to produce 32-bit signed product. Some embodiments of multiply-add/subtract 
instructions may saturate results while some alternative embodiments may truncate results. 
[0122] Figure 8b illustrates a circuit for performing multiply-add and/or multiply- 
subtract operations on packed word data according to another alternative embodiment of 
the invention. Operation control 800 outputs signals on Enable 880 to control Packed 
multiply-adder/subtracter 801. Packed multiply-adder/subtracter 801 has inputs: 
Sourcel[63:0] 831, Source2[63:0] 833, and Enable 880. Packed multiply-adder/subtracter 
801 includes 16x16 multiplier circuits and 32-bit adders. A first 16x16 multiplier 
comprises booth encoder 823, which has as inputs Source 1 [63:48] and Source2[63:48]. 
Booth encoder 823 selects partial products 826 based on the values of its inputs 
Sourcel [63:48] and Source2[63:48]. A second 16x16 multiplier comprises booth encoder 
822, which has as inputs Sourcel [47:32] and Source2[47:32]. Booth encoder 822 selects 
partial products 824 based on the values of its inputs Sourcel [47:32] and Source2[47:32]. 
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For example, in one embodiment of Booth encoder 822, the three bits, Sourcel [47:45], 
may be used to select a partial product of zero (if Sourcel [47:45] are 000 or 1 1 1); 
Source2[47:32] (if Sourcel [47:45] are 001 or 010); 2 times Source2[47:32] (if 
Sourcel [47:45] are 01 1); negative 2 times Source2[47:32] (if Sourcel [47:45] are 100); or 
negative 1 times Source2[47:32] (if Sourcel [47:45] are 101 or 110). Similarly, 
Sourcel [45:43], Sourcel [43:41], Sourcel [4 1:39], etc. may be used to select their 
respective partial products 824. 

[0123] Partial products 824 and partial products 826 are provided as inputs to 
compression array 825, each group of partial products being aligned in accordance with the 
respective bits from Sourcel used to generation them. For one embodiment compression 
array 825 may be implemented as a Wallace tree structure of carry-save adders. For 
alternative embodiments compression array 825 may be implemented as a sign-digit adder 
structure. The intermediate results from compression array 825 are received by adder 851. 
[0124] Based on whether the current instruction is a multiply-add or multiply-subtract 
instruction, compression array 825 and adder 851 add or subtract the products. The 
outputs of the adders including adder 851 (i.e., bits 63 through 32 of the Result) are 
combined into the 64-bit Result and communicated to Result Register 871. It will be 
appreciated that alternative embodiments of packed multiplier-adder/subtracter may accept 
source inputs of various sizes, 128 bits for example. 

[0125] Figure 8c illustrates a circuit for performing multiply-add and/or multiply- 
subtract operations on packed byte data or packed word data according to another 
alternative embodiment of the invention. The packed multiply-add/subtract circuit of 
Figure 8d has inputs: Sourcel [63:48], Source2[63:48]. For one embodiment, when 
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multiplexer (MUX) 832 selects Sourcel [63:56], MUX 834 selects Source 1 [55:48], and 
when MUX 836 and MUX 838 select Source2[63:48], a 16x16 multiplication may be 
performed substantially as described with reference to Figure 8c. On the other hand, when 
MUX 832 selects Sourcel [55:48], MUX 834 selects Sourcel [63:56], MUX 836 selects 
Source2[63:56] and MUX 838 select Source2[55:48], two 8x8 multiplications may be 
performed as described below. 

[0126] A 16x16 multiplier comprises encoder 863, which has as inputs Sourcel [55:48] 
from MUX 832 and Source2[55:48] from MUX 838. Encoder 863 selects partial products 
for the lower portion of partial products 826. Source2[55:48] from MUX 838 has eight 
upper bits padded with zeroes, and so the lower right quadrant of partial products 826 
corresponds to partial products for the byte multiplication of Sourcel [55:48] and 
Source2[55:48], while the lower left quadrant of partial products 826 contains zeroes. The 
16x16 multiplier further comprises encoder 843, which has as inputs Sourcel [63:56] from 
MUX 834 and Source2[63:56] from MUX 836. Encoder 843 selects partial products for 
the upper portion of partial products 826. Source2[63:56] from MUX 836 has eight lower 
bits padded with zeroes so the upper left quadrant of partial products 826 corresponds to 
partial products for the byte multiplication of Sourcel [63:56] and Source2[63:56], while 
the upper right quadrant of partial products 826 contains zeroes. It will be appreciated that 
by aligning the partial products as described, addition of the two 16-bit products is 
facilitated through addition of the partial products. 

[0127] Partial products 826 are provided as inputs to compression array 827, which 
provides inputs to full adder 858. Partial products 826 may be aligned to also facilitate 
generation of a 32-bit result. Therefore, in such cases, the outputs of full adder 858 
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corresponding to bits twenty-three through eight contain the 16-bit sum that may be 
provided to MUX 835, while the full 32-bit output of full adder 858 may be provided, for 
example, to full adder 851 when performing multiply-add/subtract operations on packed 
word data. For one embodiment, the outputs of the adders including adder 858 are 
optionally saturated to signed 16-bit values (i.e., bits 63 through 48 of the Result) are and 
are then combined into the 64-bit Result and communicated to Result Register 871. 
[0128] For one embodiment of saturation detection logic 837, all of the bits 
corresponding to the result may be examined in order to determine when to saturate. It 
will be appreciated that alternative embodiments of multiply-add/subtract operations, 
saturation detection logic 837 may examine less than all of the bits corresponding to the 
result. 

[0129] From the inputs it is possible to determine the direction of the potential 
saturation and select a saturation constant to provide to MUX 851. A signed result has the 
potential to saturate to a negative hexadecimal value of 8000, only if both products are 
negative. For example, when one packed byte source has unsigned data elements and the 
other packed byte source has signed data elements, the negative hexadecimal saturation 
value of 8000 may be provided as the saturation constant to MUX 851 when both signed 
data elements, Source2[63:56] and Source2[55:48] for example, are negative. Similarly, 
since a signed result has the potential to saturate to a positive value, only if both products 
are positive, the positive hexadecimal saturation value of 7FFF may be provided as the 
saturation constant to MUX 851 when both signed data elements, Source2[63:56] and 
Source2[55:48] for example, are positive. 
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[0130] For one embodiment of the multiply-add/subtract only particular bit patterns 
may occur in signed results. Therefore it may be possible for saturation detection logic to 
identify the particular bit patterns which saturate. For example, using the sum bits, at bit 
positions 15 and 16 of a 17-bit adder prior to carry propagation and also using the carry-out 
of bit position 14, saturation detection logic may signal MUX 835 to saturate when 
sum[16:15] are 01, when sum[16:15] are 00 and Coutl4 is 1, or when sum[16:15] are 10 
and Coutl4 is 0. Therefore saturation detection logic 837 may detect saturation before a 
final result is available from full adder 851. 

[0131] Figure 8d illustrates another circuit for performing multiply-add and/or 
multiply-subtract operations on packed byte data or packed word data according to another 
alternative embodiment of the invention. The packed multiply-add/subtract circuit of 
Figure 8e has inputs: Source 1 [63:48], Source2[63:48]. For one embodiment, when MUX 
836 and MUX 838 select Source2[63:48], a 16x16 multiplication may be performed 
substantially as described with reference to Figure 8c. On the other hand, when MUX 836 
selects Source2[55:48] and MUX 838 select Source2[63:56], two 8x8 multiplications may 
be performed as described below. 

[0132] A 16x16 multiplier comprises encoder 863, which has as inputs Sourcel [63:56] 
and Source2[63:56] from MUX 838. Encoder 863 selects partial products for the lower 
portion of partial products 826. Source2[63:56] from MUX 838 has eight upper bits 
padded with zeroes, and so the lower right quadrant of partial products 826 corresponds to 
partial products for the byte multiplication of Sourcel [63:56] and Source2[63:56], while 
the lower left quadrant of partial products 826 contains zeroes. The 16x16 multiplier 
further comprises encoder 843, which has as inputs Sourcel [55:48] and Source2[55:48] 
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from MUX 836. Encoder 843 selects partial products for the upper portion of partial 
products 826. Source2[55:48] from MUX 836 has eight lower bits padded with zeroes so 
the upper left quadrant of partial products 826 corresponds to partial products for the byte 
multiplication of Sourcel [55:48] and Source2[55:48], while the upper right quadrant of 
partial products 826 contains zeroes. It will be appreciated that by aligning the partial 
products as described, addition of the two 16-bit products is facilitated through addition of 
the partial products. 

[0133] Partial products 826 are provided as inputs to compression array 827, which 
provides inputs to full adder 858. Full adder 858 output bits twenty-three through eight 
contain the 16-bit sum that may be provided to MUX 835, while the full 32-bit output of 
full adder 858 may be provided, for example, to full adder 851 when performing multiply- 
add/subtract operations on packed word data. From the inputs it is possible to determine 
the direction of the potential saturation and select a saturation constant to provide to MUX 
851. Saturation detection logic 837 may detect saturation before a final result is available 
from full adder 851. For one embodiment, the outputs of the adders including adder 858 
are optionally saturated to signed 16-bit values (i.e., bits 63 through 48 of the Result) are 
and are then combined into the 64-bit Result and communicated to Result Register 871. 
[0134] Figure 9a is a flow diagram illustrating one embodiment of a process 91 1 for 
performing the horizontal-add operation (which may also be referred to as adjacent-add or 
intra-add). Process 91 1 begins from a start state and proceeds to processing block 901 
where a control signal is decoded. In particular, the control signal identifies an operation 
code of a horizontal add or horizontal-add instruction. The process 91 1 then advances to 
processing block 902, where the registers in a register file or a memory are accessed at 
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locations specified by the SRC1 and SRC2 addresses. The register file or memory 
provides an execution unit with the packed data (Source 1) stored in at the SRC1 address, 
and the packed data (Source2) stored at the SRC2 address. 

[0135] Process 911 proceeds to processing block 903, where the execution unit is 
enabled to perform the horizontal-add operation. Next, process 911 advances to 
processing block 918, where the horizontal-add operation is performed. Source 1 bits 
thirty-one through zero are added to Source 1 bits sixty-three through thirty-two, generating 
a first 32-bit result (Result[31:0]). Sourcel bits ninety-five through sixty-four are added to 
Source 1 bits one hundred-and-twenty-seven through ninety-six, generating a second 32-bit 
result (Result[63:32]). Source2 bits thirty-one through zero are added to Source2 bits 
sixty-three through thirty-two, generating a third 32-bit result (Result[95:64]). Source2 
bits ninety-five through sixty-four are added to Sourcel bits one hundred-and-twenty- 
seven through ninety-six, generating a fourth 32-bit result (Result[127:96]). 
[0136] The process 911 advances to processing block 920, where the results of the 
horizontal-add instruction are stored in a register in a register file or a memory at the 
DEST address. The process 911 then terminates. Of course, the process of Figure 9a can 
be easily altered to describe the horizontal addition of other packed data formats. 
[0137] Figure 9b is a flow diagram illustrating one embodiment of a process 921 for 
performing the horizontal-subtract operation. Process 921 begins from a start state and 
proceeds to processing block 901 where, again, a control signal is decoded. In particular, 
the control signal identifies an operation code of a horizontal subtract or horizontal- 
subtract instruction. The process 921 then advances to processing block 902, where the 
registers in a register file or a memory are accessed at locations specified by the SRC1 and 
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SRC2 addresses. The register file or memory provides an execution unit with the packed 
data (Source 1) stored in at the SRC1 address, and the packed data (Source2) stored at the 
SRC2 address. 

[0138] Process 921 proceeds to processing block 903, where the execution unit, in 
accordance with the instruction decoded, is enabled to perform the horizontal-subtract 
operation. Next, process 921 advances to processing block 928, where the horizontal- 
subtract operation of is performed. Source 1 bits sixty-three through thirty-two are 
subtracted from Source 1 bits thirty-one through zero, generating a first 32-bit result 
(Result[31:0]). Sourcel bits one hundred-and-twenty-seven through ninety-six are 
subtracted from Sourcel bits ninety-five through sixty-four, generating a second 32-bit 
result (Result[63:32]). Source2 bits sixty-three through thirty-two are subtracted from 
Source2 bits thirty-one through zero, generating a third 32-bit result (Result[95:64]). 
Source2 bits one hundred-and-twenty-seven through ninety-six are subtracted from 
Source2 bits ninety-five through sixty-four, generating a fourth 32-bit result 
(Result[127:96]). 

[0139] The process 921 advances to processing block 920, where the results of the 
horizontal-subtract instruction are stored in a register in a register file or a memory at the 
DEST address. The process 921 then terminates. 

[0140] Figure 9c is a flow diagram illustrating an alternative embodiment of a process 
931 for performing the horizontal-add operation. Process 931 begins from a start state and 
proceeds to processing block 901 where a control signal is decoded. In particular, the 
control signal identifies an operation code of an horizontal-add instruction. In processing 
block 902 the registers in a register file or a memory are accessed according to the SRC1 
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and SRC2 addresses. The register file or memory provides the execution unit with 
Source 1 stored in at the SRC1 address, and Source2 stored at the SRC2 address. 
[0141] In processing block 903, the execution unit is enabled to perform the 
horizontal-add operation. Next, in processing block 938, Source 1 bits thirty-one through 
sixteen are added to Source 1 bits fifteen through zero, generating a first 16-bit result 
(Result[15:0]). Sourcel bits sixty-three through forty-eight are added to Sourcel bits one 
forty-seven through thirty-two, generating a second 16-bit result (Result[31:16]). Sourcel 
bits ninety-five through eighty are added to Sourcel bits seventy-nine through sixty-four, 
generating a third 16-bit result (Result[47:32]). Sourcel bits one hundred-and-twenty- 
seven through one hundred-and-twelve are added to Sourcel bits one hundred-and-eleven 
through ninety-six, generating a fourth 16-bit result (Result[63:48]). Source2 bits thirty- 
one through sixteen are added to Source2 bits fifteen through zero, generating a fifth 16-bit 
result (Result[79:64]). Source2 bits sixty-three through forty-eight are added to Source2 
bits one forty-seven through thirty-two, generating a sixth 16-bit result (Result[95:80]). 
Source2 bits ninety-five through eighty are added to Source2 bits seventy-nine through 
sixty-four, generating a seventh 16-bit result (Result[l 1 1:96]). Source2 bits one hundred- 
and-twenty-seven through one hundred-and-twelve are added to Source2 bits one hundred- 
and-eleven through ninety-six, generating an eighth 16-bit result (Result[127:112]). 
[0142] The process 931 advances to processing block 920, where the results of the 
horizontal-add instruction are stored in a register in a register file or a memory at the 
DEST address. The process 931 then terminates. 

[0143] Figure 9d is a flow diagram illustrating an alternative embodiment of a process 
941 for performing the horizontal-subtract operation. Process 941 begins from a start state 
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and proceeds to processing block 901 where a control signal is decoded. In particular, the 
control signal identifies an operation code of an horizontal-subtract instruction. In 
processing block 902 the registers in a register file or a memory are accessed according to 
the SRC1 and SRC2 addresses. The register file or memory provides the execution unit 
with Source 1 stored in at the SRC1 address, and Source2 stored at the SRC2 address. 
[0144] In processing block 903, the execution unit is enabled to perform the 
horizontal-subtract operation. Next, in processing block 948, Sourcel bits thirty-one 
through sixteen are subtracted from Sourcel bits fifteen through zero, generating a first 16- 
bit result (Result[15:0]). Sourcel bits sixty-three through forty-eight are subtracted from 
Sourcel bits one forty-seven through thirty- two, generating a second 16-bit result 
(Result[31: 16]). Sourcel bits ninety-five through eighty are subtracted from Sourcel bits 
seventy-nine through sixty-four, generating a third 16-bit result (Result[47:32]). Sourcel 
bits one hundred-and-twenty-seven through one hundred-and-twelve are subtracted from 
Sourcel bits one hundred- and-eleven through ninety-six, generating a fourth 16-bit result 
(Result[63:48]). Source2 bits thirty-one through sixteen are subtracted from Source2 bits 
fifteen through zero, generating a fifth 16-bit result (Result [79:64]). Source2 bits sixty- 
three through forty-eight are subtracted from Source2 bits one forty-seven through thirty- 
two, generating a sixth 16-bit result (Result [95: 80]). Source2 bits ninety-five through 
eighty are subtracted from Source2 bits seventy-nine through sixty-four, generating a 
seventh 16-bit result (Result[l 1 1:96]). Source2 bits one hundred-and-twenty-seven 
through one hundred-and-twelve are subtracted from Source2 bits one hundred-and-eleven 
through ninety-six, generating an eighth 16-bit result (Result[127:l 12]). 
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[0145] The process 941 advances to processing block 920, where the results of the 
horizontal-add instruction are stored in a register in a register file or a memory at the 
DEST address. The process 941 then terminates. 

[0146] Figure 9e is a flow diagram illustrating one embodiment of a process 95 1 for 
performing the horizontal-add operation. Process 951 begins from a start state and 
proceeds to processing block 901 where a control signal that identifies an operation code 
of an horizontal-add instruction is decoded. The process 951 then advances to processing 
block 902, where the registers in a register file or a memory are accessed and the execution 
unit is supplied with the packed data (Source 1) stored in at the SRC1 address, and the 
packed data (Source2) stored at the SRC2 address. 

[0147] Process 951 proceeds to processing block 903, where the execution unit is 
enabled to perform the horizontal-add operation. Next, in processing block 958, the 
horizontal-add operation is performed. Source 1 bits thirty-one through zero are added to 
Source 1 bits sixty-three through thirty-two, generating a first 32-bit result (Result[31:0]). 
Source2 bits thirty-one through zero are added to Source2 bits sixty-three through thirty- 
two, generating a second 32-bit result (Result[63:32]). 

[0148] The process 951 advances to processing block 920, where the results of the 
horizontal-add instruction are stored in a register in a register file or a memory at the 
DEST address. The process 951 then terminates. 

[0149] Figure 9f is a flow diagram illustrating another alternative embodiment of a 
process 961 for performing the horizontal-subtract operation. Process 961 begins from a 
start state and proceeds to processing block 901 where, a control signal that identifies an 
operation code of an horizontal-subtract instruction is decoded. The process 961 then 
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advances to processing block 902, where the registers in a register file or a memory are 
accessed and the execution unit is supplied with the packed data (Source 1) stored in at the 
SRC1 address, and the packed data (Source2) stored at the SRC2 address. 
[0150] Process 961 proceeds to processing block 903, where the execution unit, in 
accordance with the instruction decoded, is enabled to perform the horizontal-subtract 
operation. Next, in processing block 968, Source 1 bits sixty-three through thirty-two are 
subtracted from Sourcel bits thirty-one through zero, generating a first 32-bit result 
(Result[31:0]). Source2 bits sixty-three through thirty-two are subtracted from Source2 
bits thirty-one through zero, generating a second 32-bit result (Result[63:32]). 
[0151] The process 961 advances to processing block 920, where the results of the 
horizontal-subtract instruction are stored in a register in a register file or a memory at the 
DEST address. The process 961 then terminates. 

[0152] Figure 9g is a flow diagram illustrating an alternative embodiment of a process 
971 for performing the horizontal-add operation. Process 971 begins from a start state and 
proceeds to processing block 901 where a control signal that identifies an operation code 
of an horizontal-add instruction is decoded. The process 971 then advances to processing 
block 902, where the registers in a register file or a memory are accessed and the execution 
unit is supplied with the packed data (Sourcel) stored in at the SRC1 address, and the 
packed data (Source2) stored at the SRC2 address. 

[0153] In processing block 903, the execution unit is enabled to perform the 
horizontal-add operation. Next, in processing block 978, Sourcel bits thirty-one through 
sixteen are added to Sourcel bits fifteen through zero, generating a first 16-bit result 
(Result[15:0]). Sourcel bits sixty-three through forty-eight are added to Sourcel bits one 
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forty-seven through thirty-two, generating a second 16-bit result (Result[31:16]). Source2 
bits thirty-one through sixteen are added to Source2 bits fifteen through zero, generating a 
third 16-bit result (Result[47:32]). Source2 bits sixty-three through forty-eight are added 
to Source2 bits one forty-seven through thirty-two, generating a fourth 16-bit result 
(Result[63:48]). 

[0154] The process 971 advances to processing block 920, where the results of the 
horizontal-add instruction are stored in a register in a register file or a memory at the 
DEST address. The process 971 then terminates. 

[0155] Figure 9h is a flow diagram illustrating an alternative embodiment of a process 
981 for performing the horizontal-subtract operation. Process 981 begins from a start state 
and proceeds to processing block 901 where a control signal that identifies an operation 
code of an horizontal-subtract instruction is decoded. The process 981 then advances to 
processing block 902, where the registers in a register file or a memory are accessed and 
the execution unit is supplied with the packed data (Source 1) stored in at the SRC1 
address, and the packed data (Source2) stored at the SRC2 address. 
[0156] In processing block 903, the execution unit is enabled to perform the 
horizontal-add operation. Next, in processing block 988, Sourcel bits thirty-one through 
sixteen are subtracted from Sourcel bits fifteen through zero, generating a first 16-bit 
result (Result[15:0]). Sourcel bits sixty-three through forty-eight are subtracted from 
Sourcel bits one forty-seven through thirty-two, generating a second 16-bit result 
(Result[31:16]). Source2 bits thirty-one through sixteen are subtracted from Source2 bits 
fifteen through zero, generating a third 16-bit result (Result[47:32]). Source2 bits sixty- 
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three through forty-eight are subtracted from Source2 bits one forty-seven through thirty- 
two, generating a fourth 16-bit result (Result[63:48]). 

[0157] The process 981 advances to processing block 920, where the results of the 
horizontal-add instruction are stored in a register in a register file or a memory at the 
DEST address. The process 981 then terminates. It will be appreciated that any of the 
processes of Figs. 9a-9h may be performed with signed saturation, with unsigned 
saturation or without saturation. 



Packed Data horizontal Add/Subtract Circuits 
[0158] In one embodiment, the horizontal-add/subtract instructions can execute on 
multiple data elements in the same number of clock cycles as an horizontal-add operation 
on unpacked data. To achieve execution in the same number of clock cycles, parallelism 
is used. 

[0159] Figure 10a illustrates one embodiment of a circuit for performing horizontal or 
horizontal-add/subtract operations. Operation control 1010 processes the control signal for 
the horizontal-add operations. Operation control 1010 outputs signals via signal line(s) 
1020 to control horizontal-adder 1030. 

[0160] The horizontal-adder 1030 receives inputs from Source 1 [127:0], 
Source2[127:0], and Enable 1020. The horizontal-adder 1030 includes four adder circuits 
1032, 1034, 1036 and 1038. Adder 1032 receives inputs from Source2[127:64], adder 
1034 receives inputs from Source2[63:0], adder 1036 receives inputs from 
Sourcel [127:64], while adder 1038 receives inputs from Source 1 [63:0]. When enabled, 
the adders 1032, 1034, 1036 and 1038 sum their respective inputs, and each generates a 
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32-bit output. The results of the addition by adder 1032 (i.e., Result[ 127:96]), adder 1034 
(i.e., Result[95:64], by adder 1036 (i.e., Result[63:32]), and by adder 1038 (i.e., 
Result[31:0]) are combined into the 128-bit Result and communicated to the Result 
Register 1040. 

[0161] Figure 10b illustrates an alternative embodiment of a circuit for performing 
horizontal or horizontal-add/subtract operations. Operation control 1010 processes the 
control signal for the horizontal-add/subtract operations. Operation control 1010 outputs 
signals via signal line(s) 1020 to control adders 1031 and 1033, multiplexers m0-mF, 
multiplexers 1039 and saturation circuitry 1040. Through the use of multiplexers m0-mF, 
operand data elements from Source 1 and Source2 may be aligned to positions at the inputs 
of adders 1031 and 1033 to facilitate horizontal or horizontal-addition/subtraction as well 
as to facilitate vertical or inter-addition/subtraction. Through the use of multiplexers 1039, 
the results form adders 1031 and 1033 may be aligned to facilitate horizontal- 
addition/subtraction of different width operands, Source 1 and Source2. It will be 
appreciated that various sizes of operand data elements and of operands Source 1 and 
Source2 may be supported through such an approach. 

[0162] For example, one embodiment of horizontal-add/subtract operations as 
illustrated in Figures 3a and 3b and as described in Figures 8g and 8h, respectively, uses 
16-bit data elements 1014-1011 of Source 1 and 1024-1021 of Source2. To accomplish 
such an operation through the use of adder 1033, operation control 1010 signals for the 
outputs of multiplexers m3-m0 to be elements 1024, 1022, 1014 and 1012 respectively. 
Operation control 1010 signals for the outputs of multiplexers mB-m8 to be elements 
1023, 1021, 1013 and 1011 respectively. In this way adder 1033 can perform a 16-bit 
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horizontal-addition/subtraction in substantially the same manner as a 16-bit inter- 
addition/subtraction, producing element 1023 plus/minus element 1024, element 1021 
plus/minus element 1022, element 1013 plus/minus element 1014, and element 1011 
plus/minus element 1012. Operation control 1010 also signals for the multiplexers 1039 
to pass through results from the adders without realigning them and so the results may be 
optionally saturated and stored as elements 1044-1041 respectively. 
[0163] An alternative embodiment of horizontal-add/subtract operations as illustrated 
in Figure 3c and as described in Figures 8e and 8f, respectively, uses 32-bit data elements 
1014-1013, and 1012-1011 of Source 1 and 1024-1023, and 1022-1021 of Source2. To 
accomplish such an operation through the use of adder 1033, operation control 1010 
signals for the outputs of multiplexers m3-m0 to be elements 1024, 1023, 1014 and 1013 
respectively. Operation control 1010 signals for the outputs of multiplexers mB-m8 to be 
elements 1022, 1021, 1012 and 1011 respectively. In this way adder 1033 can perform a 
32-bit horizontal-addition/subtraction in substantially the same manner as a 32-bit inter- 
addition/subtraction, producing element 1022-1021 plus/minus element 1024-1023, and 
element 1012-1011 plus/minus element 1014-1013. Once again operation control 1010 
signals for the multiplexers 1039 to pass through results from the adders without 
realigning them and so the results may be optionally saturated and stored as two 32-bit 
elements 1044-1043 and 1042-1041 respectively. 

[0164] Another alternative embodiment of horizontal-add/subtract operations as 
illustrated in Figures 3a and 3b and as described in Figures 8a and 8b, respectively, uses 
four 32-bit elements 1018-1017, 1016-1015, 1014-1013, and 1012-1011 of Source 1 and 
1028*1027, 1026-1025, 1024-1023, and 1022-1021 of Source2. To accomplish such an 
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operation through the use of adders 1031 and 1033, operation control 1010 signals for the 
outputs of multiplexers m7-m0 to be elements 1028, 1027, 1018, 1017, 1024, 1023, 1014 
and 1013 respectively. Operation control 1010 signals for the outputs of multiplexers mF- 
m8 to be elements 1026, 1025, 1016, 1015, 1022, 1021, 1012 and 1011 respectively. In 
this way adders 1031 and 1033 can perform 32-bit horizontal-additions/subtractions in 
substantially the same manner as 32-bit inter-additions/subtractions, producing element 
1026-1025 plus/minus element 1028-1027, element 1016-1015 plus/minus element 1018- 
1017, element 1022-1021 plus/minus element 1024-1023, and element 1012-1011 
plus/minus element 1014-1013. For the 128-bit operands, operation control 1010 signals 
for the multiplexers 1039 to realign the two middle results from the adders by swapping a 
result from adder 1031 (bits 95-64) with a result from adder 1033 (bits 63-32) to produce 
element 1026-1025 plus/minus element 1028-1027, element 1022-1021 plus/minus 
element 1024-1023, element 1016-1015 plus/minus element 1018-1017, and element 
1012-101 1 plus/minus element 1014-1013. These results may be optionally saturated and 
stored as four 32-bit elements 1048-1047 and 1046-1045 1044-1043 and 1042-1041 
respectively. 

[0165] It will be appreciated that multiplexers 1039 may provide timing advantages by 
reducing some of the wiring delay associated with 128-bit operands and reducing 
multiplexer complexity before the adder. It will also be appreciated that techniques such 
as those illustrated by Figure 10b may be modified in arrangement or detail without 
departing from the broader spirit of the invention. 

[0166] Another embodiment of horizontal-add/subtract operations as described in 
Figures 8c and 8d, respectively, uses 16-bit data elements 1018-101 1 of Source 1 and 1028- 
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1021 of Source2. To accomplish such an operation through the use of adders 1031 and 
1033, operation control 1010 signals for the outputs of multiplexers m7-m0 to be elements 
1028, 1026, 1018, 1016, 1024, 1022, 1014 and 1012 respectively. Operation control 1010 
signals for the outputs of multiplexers mF-m8 to be elements 1027, 1025, 1017, 1015, 
1023, 1021, 1013 and 1011 respectively. In this way adders 1031 and 1033 can perform 
16-bit horizontal-additions/subtractions in substantially the same manner as 16-bit inter- 
additions/subtractions, producing element 1027 plus/minus element 1028, element 1025 
plus/minus element 1026, element 1017 plus/minus element 1018, element 1015 
plus/minus element 1016, 1023 plus/minus element 1024, element 1021 plus/minus 
element 1022, element 1013 plus/minus element 1014, and element 1011 plus/minus 
element 1012. For the 128-bit operands, operation control 1010 signals for the 
multiplexers 1039 to realign the four middle results from the adders by swapping two 
results from adder 1031 (bits 95-64) with two results from adder 1033 (bits 63-32) to 
produce element 1027 plus/minus element 1028, element 1025 plus/minus element 1026, 
1023 plus/minus element 1024, element 1021 plus/minus element 1022, element 1017 
plus/minus element 1018, element 1015 plus/minus element 1016, element 1013 
plus/minus element 1014, and element 1011 plus/minus element 1012. These results may 
be optionally saturated and stored as 16-bit elements 1048-1041 respectively. 
[0167] For performing vertical or inter-addition/subtraction operations, operation control 
1010 signals for the outputs of multiplexers m7-m0 to be elements 1018-101 1 respectively 
and for the outputs of multiplexers mF-m8 to be elements 1028-1021 respectively. 
Operation control 1010 signals for the multiplexers 1039 to pass through results from the 
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adders without realigning them and so the results may be optionally saturated according to 
the operation and stored as 1048-1041 respectively. 

[0168] Figures lla-llb illustrate flow diagrams of one embodiment of a process for 
efficient integer transform processing of content data. For the sake of clarity, examples 
illustrated in Figures 1 la-1 lb, Figure 12, Figure 13, and Figures 14a-14f show a line of 
data ordered from left to right consistent with a memory ordering of the content data or the 
coefficient data. It will be appreciated that some register orderings (for example, little- 
endian) reverse the in-register ordering of elements (addresses increasing from right to left) 
with respect to their memory ordering (addresses increasing left to right). Never the less, 
operations illustrated may be carried out in substantially the same manner. In addition, a 
register storing one or more lines of packed data may be storing data representing one or 
more rows and/or one or more columns of data. 

[0169] In processing block 1 101, a multiply-add operation is performed on a line of 
packed byte data 1111-1118 stored in SRC1 and one or more lines of coefficients 1121- 
1128 stored in SRC2 to generated 16-bit products 1131-1138 which are summed by pairs 
to generate 16-bit sums of products 1 145-1 148 in DEST. In processing block 1 102, a 
second multiply-add operation is performed on the second packed byte data 1 151-1 158 
stored in SRC1 of the second multiply-add, and on coefficients 1 161-1 168 stored in SRC2 
to generated 16-bit products 1 171-1 178 which are summed by pairs to generate 16-bit 
sums of products 1 141-1 144 in DEST. Processing proceeds to processing block 1 103 
where in one embodiment, a horizontal-add operation is performed to sum the packed 16- 
bit sums of products 1 145-1 148 in SRC1 and the packed 16-bit sums of products 1 141- 
1 144 in SRC2 by pairs to generate 16-bit sums of products 1191-1 194 in DEST of the 
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horizontal-add, in similarity to the process of Figure 9g, 16-bit sums of products 1191- 
1 194 representing the results of applying a separable 4x4 integer transform to 4 bytes of 
content data in one dimension. It will be appreciated that multiply-add operations and 
horizontal-add operations may be applied as shown to 4 bytes of packed content data or 
may be applied to 8 or 16 or more bytes of packed content data. It will also be appreciated 
that while the examples illustrated process packed bytes of packed content data, alternative 
embodiments may process packed 16-bit words of content data some other conveniently 
chosen quantity of data. 

[0170] Figures 12 illustrates a flow diagram of an alternative embodiment of a process 
for efficient integer transform processing of 8 bytes of packed content data. In processing 
block 1201, a multiply-add operation is performed on a line of packed byte data 1210 
stored in SRC1 and all four lines of packed coefficients 1220 stored in SRC2 to generated 
16-bit products that are summed by pairs to generate packed 16-bit sums of products 1241 
in DEST. In processing block 1202, a second multiply-add operation is performed on the 
second packed byte data 1250 stored in SRC1 and packed coefficients 1260 stored in 
SRC2 to generated 16-bit products that are summed by pairs to generate packed 16-bit 
sums of products 1242 in DEST of the second multiply-add. Processing proceeds to 
processing block 1203 where a horizontal-add operation is performed to sum the packed 
16-bit sums of products 1 141 in SRC1 and the packed 16-bit sums of products 1 142 in 
SRC2 by pairs to generate 16-bit sums of products 1290 in DEST of the horizontal-add, 
which represent the results of applying a separable 4x4 integer transform to 8 bytes of 
content data in one dimension. For example, one embodiment of the horizontal-add 
operation of processing block 1203 sums the packed 16-bit sums of products 1241, fw-ex 
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and ey-fz, in SRC1 of the horizontal-add and the packed 16-bit sums of products 1242, fs- 
et and eu-fv, in SRC2 of the horizontal-add to generate, respectively, two 16-bit sums of 
products 1290, Z' and V, in DEST, in similarity to the process of Figure 9c. 
[0171] It will be appreciated that saturating multiply-add operations and/or horizontal- 
add operations may be applied as shown to 8 bytes of packed content data or may be 
applied to 4 or 16 or more bytes of packed content data. It will also be appreciated that the 
bytes of content data may be unsigned bytes and that the bytes of coefficient data may be 
signed bytes. For one embodiment of an integer transform, it may be convenient to 
arrange the content data in a packed format, using prior art unpacking operations for 
example, to facilitate efficient processing with multiply-add and horizontal-add operations 
or to arrange the results in a packed format for further processing and/or for storage in 
memory. For one alternative embodiment of and integer transform, it may also be 
convenient to transform an entire block of content data in both the horizontal and the 
vertical directions without storing temporary results to memory. 
[0172] Figure 13 illustrates one exemplary embodiment of an integer transform for 
processing of content data. The content data may be expressed as 4x4 matrix, for example 
a two dimensional array of pixel values may be written as shown in Figure 13 as follows: 
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[0173] As described above, an integer transform may be expressed as 4x4 matrix of 
coefficient values, which may be written as follows: 
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and the integer transform calculation may be expressed as a matrix product of the integer 
transform matrix, the content matrix and the transpose of the integer transform matrix, 
written as follows: 

A = T 4 DT/. 

[0174] This application describes a method and apparatus for including in a processor 
instructions for performing integer transforms on packed data. One embodiment of an 
integer transform performs the matrix operations from right to left, computing first the 
matrix product 1320 from the matrix multiplication 1310 as: 
B = D T 4 r , 

and computing next the matrix product 1340 from the matrix multiplication 1330 as: 
A = T 4 B . 

[0175] For example, a well known set of equations 1350 for computing the elements of 
the matrix product 1320 are illustrated in Figure 13. It will be appreciated that the 
techniques herein described are of a general nature and are applicable to any matrix 
multiplication or to any chained matrix multiplications and not just integer transforms or 
those wherein one matrix is the transpose of another matrix. 

42P15771 -65- 



[0176] Figures 14a-14f illustrate flow diagrams of another alternative embodiment of 
a process for efficient integer transform processing 16 bytes of packed content data. In 
processing block 1401, a multiply-add operation is performed on four lines of packed byte 
data 1421 stored in SRC1 and a line of packed coefficients 1431 stored in SRC2 to 
generated 16-bit products that are summed by pairs to generate packed 16-bit sums of 
products 1441 in DEST. In processing block 1402, a second multiply-add operation is 
performed on the packed byte data 1451 stored in SRC1 and another line of packed 
coefficients 1461 stored in SRC2 to generated 16-bit products that are summed by pairs to 
generate packed 16-bit sums of products 1442 in DEST of the second multiply-add 
operation. Processing proceeds to processing block 1403 where a horizontal-add operation 
is performed to sum the packed 16-bit sums of products 1441 in SRC1 and the packed 16- 
bit sums of products 1442 in SRC2 by pairs to generate 16-bit sums of products 1491 in 
DEST in similarity to the process of Figure 9c, 16-bit sums of products 1491 representing 
half the results of applying a separable 4x4 integer transform to 16 bytes of content data in 
a first dimension. 

[0177] In processing block 1404, a third multiply-add operation is performed on 
packed byte data 1422 stored in SRC1 and packed coefficients 1432 stored in SRC2 to 
generated 16-bit products that are summed by pairs to generate packed 16-bit sums of 
products 1443 in DEST of the third multiply-add. In processing block 1405, a fourth 
multiply-add operation is performed on the packed byte data 1452 stored in SRC1 and 
packed coefficients 1462 stored in SRC2 to generated 16-bit products that are summed by 
pairs to generate packed 16-bit sums of products 1444 in DEST of the fourth multiply-add. 
Processing proceeds to processing block 1406 where a second horizontal-add operation is 

42P15771 -66- 



performed to sum the packed 16-bit sums of products 1443 in SRC1 and the packed 16-bit 
sums of products 1444 in SRC2 by pairs to generate 16-bit sums of products 1492 in 
DEST representing the other half of the results of applying a separable 4x4 integer 
transform to 16 bytes of content data in the first dimension. 

[0178] It will be appreciated that upon completion of one embodiment of a 4x4 integer 
transform of content data in the first dimension, the results 1491 and 1492 may be 
arranged in column order to facilitate applying the separable 4x4 integer transform in the 
second dimension. 

[0179] In Figure 14c processing optionally proceeds to processing block 1407, where 
a fifth multiply-add operation is performed on two lines of packed 16-bit data 1491 stored 
in SRC1 and a line of packed coefficients 1423 stored in SRC2 to generated 32-bit 
products that are summed by pairs to generate packed 32-bit sums of products 1471 in 
DEST of the fifth multiply-add. In processing block 1408, a sixth multiply-add operation 
is performed on two more lines of the packed 16-bit data 1492 stored in SRC1 and packed 
coefficients 1423 stored in SRC2 to generated 32-bit products that are summed by pairs to 
generate packed 32-bit sums of products 1472 in DEST of the sixth multiply-add. 
Processing proceeds to processing block 1409 where a third horizontal-add operation is 
performed to sum the packed 32-bit sums of products 1471 in SRC1 and the packed 32-bit 
sums of products 1472 in SRC2 by pairs to generate 16-bit sums of products 1493 in 
DEST representing one fourth of the results of applying a separable 4x4 integer transform 
to 16 bytes of content data in the second dimension. 

[0180] Processing proceeds to processing block 1410, where a seventh multiply-add 
operation is performed on packed 16-bit data 1491 stored in SRC1 and packed coefficients 
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1424 stored in SRC2 to generated 32-bit products that are summed by pairs to generate 
packed 32-bit sums of products 1473 in DEST of the seventh multiply-add. In processing 
block 1411, a eighth multiply-add operation is performed on the packed 16-bit data 1492 
stored in SRC1 and packed coefficients 1424 stored in SRC2 to generated 32-bit products 
that are summed by pairs to generate packed 32-bit sums of products 1474 in DEST of the 
eighth multiply-add. Processing proceeds to processing block 1412 where a fourth 
horizontal-add operation is performed to sum the packed 32-bit sums of products 1473 in 
SRC1 and the packed 32-bit sums of products 1474 in SRC2 by pairs to generate 32-bit 
sums of products 1494 in DEST representing two fourths of the results of applying a 
separable 4x4 integer transform to 16 bytes of content data in the second dimension. 
[0181] Processing proceeds to processing block 1413, where a ninth multiply-add 
operation is performed on packed 16-bit data 1491 stored in SRC1 and packed coefficients 

1425 stored in SRC2 to generated 32-bit products that are summed by pairs to generate 
packed 32-bit sums of products 1475 in DEST of the ninth multiply-add. In processing 
block 1414, a tenth multiply-add operation is performed on the packed 16-bit data 1492 
stored in SRC1 and packed coefficients 1425 stored in SRC2 to generated 32-bit products 
that are summed by pairs to generate packed 32-bit sums of products 1476 in DEST of the 
tenth multiply-add. Processing proceeds to processing block 1415 where a fifth 
horizontal-add operation is performed to sum the packed 32-bit sums of products 1475 in 
SRC1 and the packed 32-bit sums of products 1476 in SRC2 by pairs to generate 32-bit 
sums of products 1495 in DEST representing three fourths of the results of applying a 
separable 4x4 integer transform to 16 bytes of content data in the second dimension. 
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[0182] Processing proceeds to processing block 1416, where a eleventh multiply-add 
operation is performed on packed 16-bit data 1491 stored in SRC1 and packed coefficients 
1426 stored in SRC2 to generated 32-bit products that are summed by pairs to generate 
packed 32-bit sums of products 1477 in DEST of the eleventh multiply-add. In processing 
block 1417, a twelfth multiply-add operation is performed on the packed 16-bit data 1492 
stored in SRC1 and packed coefficients 1426 stored in SRC2 to generated 32-bit products 
that are summed by pairs to generate packed 32-bit sums of products 1478 in DEST of the 
twelfth multiply-add. Processing proceeds to processing block 1418 where a sixth 
horizontal-add operation is performed to sum the packed 32-bit sums of products 1477 in 
SRC1 and the packed 32-bit sums of products 1478 in SRC2 by pairs to generate 32-bit 
sums of products 1496 in DEST completing the results of applying a 4x4 integer transform 
to 16 bytes of content data in the second dimension. 

[0183] Figures 15a illustrates a flow diagram for one alternative embodiment of a 

process 1501 for efficient integer transform processing of content data in accordance with 

Figures 1 la-1 lb and with Figures 14a-14b. In processing block 151 1, a multiply-add 

operation is performed on a first line of packed byte data and a first line of packed 

transform coefficients to generated an intermediate data including packed sums of 

products. In processing block 1512 a second multiply-add operation is performed on the 

first line of packed byte data and a second line of packed transform coefficients to generate 

another intermediate data including packed sums of products. In processing block 1513, a 

horizontal-add operation is performed on the sums of products of the intermediate data to 

generate a plurality of packed results. In processing block 1514, the results may optionally 

be rearranged for further processing or for storage to memory. In processing block 1515, a 
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test is performed to determine if all the lines of data have been processed, and if so 
processing terminates. Otherwise, processing repeats at processing block 1511. 
[0184] Figures 15b illustrates a flow diagram for another alternative embodiment of a 
process 1501 for efficient integer transform processing of content data in accordance with 
Figure 12. In processing block 151 1, a multiply-add operation is performed on a first line 
of packed byte data and a first line of packed transform coefficients to generated an 
intermediate data including packed sums of products. In processing block 1522 a second 
multiply-add operation is performed on a second line of packed byte data and the line of 
packed transform coefficients to generate another intermediate data including packed sums 
of products. In processing block 1513, a horizontal-add operation is performed on the 
sums of products of the intermediate data to generate a plurality of packed results. In 
processing block 1514, the results may optionally be rearranged for further processing or 
for storage to memory. In processing block 1515, a test is performed to determine if all the 
lines of data have been processed, and if so processing terminates. Otherwise, processing 
repeats at processing block 1511. 

[0185] Figures 15c illustrates a flow diagram for another alternative embodiment of a 
process 1503 for efficient integer transform processing of content data in accordance with 
Figure 14a-14f. In processing block 1531, a multiply-add operation is performed on one or 
more lines of packed byte data and a first line of packed transform coefficients to 
generated an intermediate data including packed sums of products. In processing block 
1532 a second multiply-add operation is performed on one or more lines of packed byte 
data and another line of packed transform coefficients to generate another intermediate 
data including packed sums of products. In processing block 1533, a horizontal-add 
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operation is performed on the sums of products of the intermediate data to generate a 
plurality of packed word results. In processing block 1534, a test is performed to 
determine if all word results of a first direction have been produced, and if so processing 
proceeds in processing block 1535. Otherwise, processing repeats at processing block 
1531. In processing block 1535, a multiply-add operation is performed on one or more 
lines of packed word data and a line of packed transform coefficients to generated an 
intermediate data including packed sums of products. In processing block 1536 a second 
multiply-add operation is performed on another or more lines of packed word data and the 
line of packed transform coefficients to generate another intermediate data including 
packed sums of products. In processing block 1537, a horizontal-add operation is 
performed on the sums of products of the intermediate data to generate a plurality of 
packed results. In processing block 1538, a test is performed to determine if all results of 
the block of content data have been produced, and if so processing terminates. Otherwise, 
processing repeats at processing block 1535. 

[0186] While the invention has been described in terms of several embodiments, those 
skilled in the art will recognize that the invention is not limited to the embodiments 
described. For example, numerous alternative orderings of content data and of area 
coefficients may be employed to effectively use the multiply-add instructions and the 
horizontal-add instructions for performing integer transforms of content data. The 
description is thus to be regarded as illustrative instead of limiting on the invention. From 
the discussion above it should also be apparent that especially in such an area of 
technology, where growth is fast and further advancements are not easily foreseen, the 
invention may be modified in arrangement and detail by those skilled in the art without 
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departing from the principles of the present invention within the scope of the 
accompanying claims. 



42P15771 



-72- 



